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ABSTRACT 

A Study was conducted to determine the ways in which 
multi-sensory cues can be simulated and effectively used in the 
training of pilots. Two analytical bases, one called the stimulus 
environment approach and the other an information array approach, are 
developed along with a cue taxonomy. Cues are postulated on the basis 
of information gained from the outside visual world, from sounds 
generated by the aircraft, and from aircraft motion and control 
movements. The physical characteristics of the postulated cues are 
emphasized. Hypotheses are developed based upon the effects of the 
postulated cues as they function independently and as they function 
in interaction with cues in other modalities. Experimentation is 
recommended which will lead to the verification and/or the 
modification of cue postulations- (Author/JY) 
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FOREWORD 

The aircraft pilot maintains control of his vehicle and accomplishes 
his mission through the information obtained by his senses. It is easy 
to classify the sources of this sensory information. There is the outside 
visual world, the cockpit display, motion, vibration, control feel, sound 
and even smell. To the experienced pilot, these sensory inputs provide 
important cues which, when processed, lead him to appropriate control 
inputs, or to prompt remedial action. 

The purpose of this project is to examine these sensory inputs, to 
classify them in meaningful categories, to assess their information con- 
tent singly and in combination and to develop hypotheses testable on a 
simulator research vehicle. 

The hoped-for end result of this research is a better understanding 
of the pilot’s sensory environment leading to the incorporation of en- 
vironmental simulation in flight training devices and the development of 
instructional strategies to bring novice pilots quickly up to speed in 
their use of sensory information. 




HAROLD A. VOSS 
Scientific Officer 
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1 . n IMTRODUCTION 



1.1 PURPOSE AND SCOPE 

It is generally held that piloting is primarily a visual- 
psychomotor problem but that the pilot utilizes information from 
sounds and motion sources in the process of controlling his air- 
craft. The permutations in terms of cues available, as well as 
the multiplicative relationsliips that could (and perhaps do) exist 
have expanded the scope of the problem of multi-sensory cueing to 
the point that, in the past, it has been viewed as prohibitive as a 
subject for research. As a result mudi information has been 
^'-onpiled regarding some individual areas such as vision (e.g. , 

Wulfeck, Weisz, S Raben, 1958), vjhile much less information is 
available with respect to others such as audition. Further, even 
less informaticn is available concerning the interactions of cues 
in the control of aircraft. At the same time the scope of the 
problem has not diminished. On the contrary, the variety of air- 
craft types and the variety of propulsion systems have served to 
complicate the problem and increase its scope. 

The source and ccntent of cues available to the pilot would 
seem, then, to be a function of the man, the machine, the medium, 
and the mission. (Bond, Bryan, Rigney £ Warren, 1962) In listing 
these four areas or sources of cues one readily sees the ramifications. 
Yet a logical analysis of the problem has led to the conclusion that 
there are some things about cues that are constant and that would 
hold across these four areas , This has special meaning in the field 
of simulation. The individual differences in man, the proliferation 
of machines, the variety of extra-vehicular environmenteil factors 
(the media) and the various types of missions are indeed different 
in terms of stdmiuli and responses. Yet, there are some constants 
that hold over these variations. It becomes a task of postulating 
these constants, quantify ng and speci^ing them^ in physical terms 
and applying them to the simulator, if the simulator is to become 
anything more than an instrumented proced^.tral device. The magnitude 
of the problem is evident. 

This report represents an attempt to deal directly with the 
problem of multi-sensory cueing, but the scope has been restricted. 

The purpose of this report is to: 

1. Outline previous pertinent research efforts in this area, 

2. Establish an appropriate analytic basis for postulating 
source and optimal content of cues in the total aircraft 
environment. 
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3. Suggest research in order to both test postulations and 
supplement areas in which infomation is rrarginal. 

4. Make determinations regarding the suitability of NTDC 
simulation facilities for the conduct of recoirmended 
research. 

In summary, even though the scope of the problem of multi- 
sensory cueing is quite lar^e, this research effort has been based cm 
the a priori assunption that thiere are constants within sensory 
modalities such that the problem need not deal with all combinations 
and permutations of man, machine, medium, and mission. Consequently, 
this effort has confined itself to postulations regarding the concept 
of the cue , its source and content , its detectability and utilizability , 
its need as a function of experience, and simulation fidelity as it 
relates to the needs of the pilot. Postulations have been based on 
piiblished research, expert opinion and judgment, pilot reports, and 
in some cases the postulations await verification through controlled 
experimental ion . 

This report deals with cues from four sources: vision, audition, 
control tiKJvements and motion. Chapters deal with these modalities 
separately along the general considerations outlined above. In 
addition, a chapter has been devoted to interaction of these cues 
aiid reccnmendations have been made for fmther research as well as 
for research equipment requirements. 

1.2 BACKGROUND 

A review of the literature demonstrates the widespread use of the 
word **cue", but there is virtually no indication as to the meaning 
intended in every instance. It is to be supposed that all who read 
such literature will irmediately understand the context and ccnnotaticn 
of the word. But as reading progresses in the field of multi-sensory 
cueing it becomes apparent that a distinction must be made between 
such word-concepts as sensation, perception, information and cue 
insofar as the concept cue is concerned. This is because the word 
cue may be taken to mean any or all of the other words. Therefore, 
for purposes of this report, the word cue has been operationally 
defined as objectively identifiable information which has a purposive 
nature. It is information which is presented to a pilot-subject 
who must subject:ively evaluate and attach some meaning to this 
information beca>.ise it calls for some purposive action or decision on 
his part. It is, in this sense, goal-directed information. 

This research was governed by the precept that any postulation, 
definition, or elaboration of a cue would have to be in terms that 
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are capable of be.ijn.g specified physically and quantitatively for 
conputer application to the simulator. Dealing with cues on a 
qualitative level was not ruled out, but only those cues that met 
the criteria outlined above were deemed acceptable. 

1.3 A TAXaiOMY OF CUES 

Preliminary analysis of the problem led to a delineation of a 
variety of cues which functioned in a number of ways in the aircraft 
environment. In order to deal more effectively with this universe 
of cues, they were divided into sets and sub-sets, yielding a 
classification of cues based on their essential character and role 
in pi aiding information to the pilot. This classification also aided 
in the determination of what information qualified as a cue and led 
to postulations regardirig the character of the cues. 

For any given event there are two disjoint sets of cues; 
relevant cues and non-relevant cues. Relevant cues comprise that set 
or cues which is directly useful to the control of the aircraft or to 
the pilot's making decisions as to the state of the aircraft or its 
control. These cues are essential to the operation of the inachine 
and must be provided for effective control. 

The set of relevant cues is coi^rised of subsets of primary , 
secondary , complementary , and con flicting cues. These subsets were 
based on the premise that the pi^dt has, for a given situation, an 
hierarchy of preferred cues in some specified order such that he seeks 
a primary cue frcm a set of primary cues available. If he obtains, 
for example, a primary visual cue, he may utilize another cue in the 
visual realm to reinforce his primary cue. This cue has been classified 
as a secondary cue. If on the other hand, the pilot obtains a cue 
from another rrbdality to reinforce his primary cue, 1his second cue 
has been classified as a coiplementary cue. Thus, cues in the same 
modality that serve to reinforce primary cues were classified as 
secondary while those from a different modality which serve to re- 
inforce the primary cue were classified as complementary. 

Cues which the pilot uses for control of his aircraft nay be 
received by two different sense modalities and these cues can be in 
opposition to each other in terms of the information they present. 

These ccnflicting cues are demonstrated in any of several ways. The 
pilot may experience vertigo and feel that his aircraft is departing 
from straight and level as a function of the cues received through 
his vestibular apparatus. At the same time his visual cues may tell 
him that he is maintaining his aircraft in the proper attitude. Here 
the motion and visual cues are in conflict. 
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The set of non-relevant cues were deemed to be non-essential 
to the successfuiir operation of an aircraft. However, they do have 
application to the simulator problem. These cues serve to add 
realism or in some other V7ay add to the face validity of the task. 

There may be several primaory cues acceptable to the operator, 
any of which nay be chosen and reinforced by any one of a number of 
secondary or complementary cues. These cues are task-dependent and 
are subject to modifications with time and the circumstances or needs 
of the individual. 

An implicit assunption was made that a cue, in order to be a cue, 
must be discriminable. There are times when information in the form 
of a cue is not discriminable by the pilot. In this situation certain 
information may mask the cue, servinf^ to increase the threshold of 
detection. One may consider these effects as masking cues in the 
sense that they obscure the relevant cues. However, this may be some- 
thing of a misnomer since they could qualify as opposing or conflicting 
cues in seme instances. At any rate the problem was considered to be 
of sufficient importance to warrant separate consideration. 

As indicated earlier a cue is a member of a given set only in 
a given circumstance. The characteristics of the cues were considered 
in order to demonstrate this. 

One of the characteristics of cues considered in making the 
several postulations in this report was the transitive nature of the 
cues. As the nature of the machine, the medium, and the mission 
changes the needs of the man change. In conjunction with these changes 
a relevant cue may become non-relevant. Or a primary cue may become 
secondary, etc. In other words, cues are task-dependent and also 
depend on momentary needs of the operator; this is reflected in the 
dnaracteristic ability of a cue to supplement or oppose other infor- 
mation, to function independently, or to be dependent on other 
information, or to otherwise change in the hierarchy of the operator. 

Cues were also considered to be relative in their state of 
permanence. That is, the horizon may serve as a relatively stable 
cue to the attitude of the aircraft whereas a momentary vibration 
detected by the whole body may be a transitory cue indicating a r^ocket 
of turbulence. This may be contrasted with a vibration whic±i 
coirpounds itself and increases in magnitude to indicate that a system 
has failed. 

Many of these characteristics may be subsumed under a general 
heading of cue interactio n. This was indeed considered to be one of 
the central problems in imilti-sensory cueing. (A sepai’ate (Chapter 
has been devoted to this problem.) Suffice it to say, at this point, 
that the problem of interaction is not unlike the concept of inter- 
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action in statistical terms and was considered to be such in this 
study. Thus, information v;hich has the potential to act as a cue 
may behave, as it were, differently as the conditions vary under which 
this information is presented and detected. This may serve to explain, 

. at least partially, why the same information can take on the properties 

of reinforcing, opposing, coTOlementing, masking, etc. 

» An iirportant consideration in postulating aircraft control cues 

was that the term control implied a desired condition or standard to 
which the system was being coirpared and controlled. This standard has 
been termed the referent . Control also implied a controllable index 
which the pilot sought to maintain in some position in relation to the 
referent. For exanple, in seeking to control the bank angle of his 
aircraft the operator seeks to maintain the wings, i.e., the control 
index , in some position relative to the horizon, i.e., the referent . 

Thus, it was iirportant in postulating cues to control that the stimuli 
giving rise to both the referent and the controllable index be 
identified and described. 

Another important consideration in the postulation of cues was 
t>\at the aircraft is a dynamic system. VJhile the position of a 
desired index relative to a fixed referent is important, the time 
derivative of position is equally so. Rates and accelerations were 
postiiLated to be referred to standards. Parenthetically, the standard 
;f may be ”no rate** or **no acceleration*' and the cue to control is 

comprised of the perception of the deviation from suchi a standard. 

Thus, information as to rates and accelerations and their relation 
to desired or referent rates and accelerations also provides cues for 
control in the system aiid points to the dynamic (Characteristic of 
cues. 

To appreciate this dynamic aspect of the system iji the postulation 
of cues one should consider the movement of the aircraft as a changing 
physical event in which positions are changed with attendant time 
variables — rates, accelerations and rates of change of acceleration. 

To the extent that these physical events are perceptible to the operator 
they may provide cues to him for exercising control. The inportance 
of considering the dynamic actions of the system lies in the fact that 
these varied physical events may be perceived differentially as cues 
by the several sense modalities. A given physical event, i.e., departure 
of the aircraft fron level flight, mi^t provide a cue through the 
motion senses as an acceleration or rate of onset of acceleration while 
the cue through the. visual modality of a rate or a positional change 
mip^t occur later in time. It is this differential sensing both with 
respect to the aspect of the physical event which serves as a cue 
and the time at v;hic±i the cue is detected by the given sense modality 
whi( 2 h provides an additional clue to the understanding of the inter- 
action among cues. 
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1.4 CUE UTILIZATION: SOME INTERACTIVE RELATia^SHIPS 

In developing postulates about control cues it was helpful to 
develop an analytical approach and to apply it to the problem. The 
approach used here considers the aircraft pilot to function essentially 
as a process ccntrol device* As such his task is considered to be: 

1) information or data acquisition, 2) information integration, and 
3) information output through control movements or verbal communications* 

Several contingencies arise when man interfaces v;ith machine 
and these v;ere considered to be related generally to the problem of 
interaction of cues- The category of the cue and the sense modality 
through vdiich the cue is received are both dependent upon a number of 
factors in the man-machine control loop which change over time* As 
pointed out earlier, it was postulated that interactions may occur 
when cues from one sense modality mask or oppose those being perceived 
by another sense modality. The differential sensing of the aspects 
of the physical event can be illustrated by a conparison of the visual 
and nation senses. The differences in time of sensing the cue may be 
due to the fact that the txTO sense modalities are stimulated by 
different aspects of the physical event. Perhaps the visual sense 
responds to the cue of differences in position and time-rates of changes 
in position but is not particularly responsive to accelerations and 
rates of onset of acceleration. The motion senses on the other hand 
may be cued to the event through sensing accelerations and rates of 
onset . 

Cues were postulated to vary as a function of the dynamics 
of the vehicle being ccntrolled. That is, certain cues may Be 
appropriate or not as a function of the stability of the vehicle. 

The time derivatives of aircraft movement occur in a sequence which, 
under most conditions of aircraft operation, make the cues time- 
dependent in the sense that the motion senses are stimulated first. 
Precise control of the aircraft is then "modality dependent" as a 
function of the aircraft dynamics. Cues may be present or absent, 
relevant or otherwise as a function of these dynamics. Highly st^le 
and/or sla-7 responding systems such as mi^t be envisioned for 
space vehicles may provide virtually no cues to the motion sense. 

Control of such vehicles might be almost solely dependent upon visual 
cues. For control of a highly responsive system such as a military/ 
aircraft, however, great dependency may be placed upon notion cues 
for precision of control. 

During normal aircraft flight, rotational movements about its 
axes were postLiated to provide cues to the motion receptors before 
they cue the visual receptors. Metiers of the aircraft along X and Y 
space axes are postulated to be nore likely to cue f irst tKe visual 
sense through rates and differences in position rather than the 
notion senses because of the lew accelerations and rates of onset 
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usual to these systems. In order to provide useful data about 
the interaction between cues and vehicle dynamics j it is necessary 
to provide specific postulates as to hcM the cues are dependent 
upon specific parameters of dynamics such as frequency response 
and gain of the dimensicn of the vehicle being controlled and to 
test these postulates enpirically. 

An important interaction occurs between the characteristics 
of the visual display and the characteristics of the motion platform 
system. Such parameters of the visual display as gain and resolution 
may have a direct effect upon the impor^tance of motion cues in 
control of the system. 

An important interaction ray occur also when the feedback 
characteristics of the controller v/hich the pilot manipulates at a 
given time is considered. For example, the immediacy of feedback 
and the accurate positioning of the controller is postulated to be 
dependent upon controller characteristics. This dependency is 
particularly apparent when controls v;ith and without centering are 
corrpared. Moreover, control stick rass, damping and friction will 
affect its reaction as inertial mass to simulator movement. Thus, 
the interacticn of stick mass and quality of simulator motion are 
considered to be important in the differential effect they ma.y have 
on pilot performance. 

Another interactive effect or factor upon which cues are 
dependent is that of the task teing performed by the pilot , VIhen the 
pilot carries, out a conpensatory tracking task such as "low altitude 
high speed flight, the motion cues ray be postulated to precede the 
visual cues as indicators of change of aircraft attitude. This is to 
be contrasted with the task in which the pilot is pursuing a target 
at hipfi altitude under non-turbulent conditions. Here the movement 
of the target in terms of its positional and rate change may provide 
cues to ttie visual sense but not to the motion senses. 

Ttie concept of an effective time constant (t^) of the man- vehicle 
system was deemed helpful in understanding the interaction effects. 

Ihc effective time constant notion is that precision of closed-loop 
contro!L is a function of the rapidity with which the operator 
perceives the results of his control inputs into the system. The 
rare rapidly he receives feedback the more precise can be his 
control up to a point, after which too rapid feedback can disrupt 
control. The relationship between the value of t^ and precision 
of control is postulated to be a hyberbolic function. The rapidity 
of feedback is a function of the dynamics of the system being 
controlled and of characteristics of the operator - most particularly 
his thresliold for perception of the vehicle output, Ihe time between 
control input initiation and perception of vehicle output is termed 
the effective time constant (t^) of the system. 
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An important point in the concept of t^ is that different sense 
modalities may have different thresholds for a ^iven vehicle movement 
and therefore different tiine constants. It is also apparent that it 
may be possible to manipulate the stimuli to the different sense 
modalities differentially so that their respective effective time 
constants may be varied. 

In a simulator which has no motion at all the motion sensore are 
not stimulated so human operator response is dependent upon the visual 
and kinesthetic modalities. Varying the gain on the visual display 
can vary the visual threshold thus varying the effective time constant 
vjith a resultant effect upon precision of vehicle control. The 
addition of motion to the simulator provides stimuli to the motion 
sensors. Th5.s addition may be sudi that movement is sensed by the 
motion senso:rs prior to its being sensed by the visual sense. That 
is, the effective time constant for the motion sensors may be of a 
lower value than that of the visual. This earlier detection of the 
movement of the vehi.cle allcujs for the possibility of greater precision 
of control by the operator. 

Ihie effective time constent concept is a means of explaining 
and predicting hew control performance may vary as a function of 
tl\e “strength of signal** to the several modalities. It also provides 
some insight into hew the visual and motion parameters may interact 
with the vehicle dynamics. 

1.5 CUi: POSTULATIONS: VM ANALYTIC BASES 

In setting up an analytic basis for the postulations of cues 
and recommended research it seemed evident that greater generality 
of findings vjould be obtained if a frame of reference for aircraft 
control were evolved within which the cue taxonomy could be fitted. 

The frame of reference vjhich was adopted was one in which aircraft 
control was sub-divided into four major categories. Within each of 
these categories, cues to control could be postulated in keeping with 
the sets of cues listed in the previously discussed taxonomy. 

The categories of control are: 1) control about the longitudinal, 

lateral and vertical axes of the airci^aft, i.e. , attitude control; 

2) control of the aircraft along the axes of three dimensional space, 
i.e,, position in space; 3) control of the aircraft state, i.e., its 
mechmical condition; and 4) mission-related control, e.g. , reconnaissance. 
Within each of these categories the analysis vjas designed to develop 
postulates as to cues available to the pilot. As a basis for making 
the postulations, relevant literature, pilot interviews, investigator 
experience and analytic examination of the aircraft dynamics and 
equations of motion have teen considered. 
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The first analytic basis for cue postulation may be considered 
in terms of information in stimulus dimensions. This was termed the 
stimulus environment approach. This approach attempts to specify 
the pViysicaT ener^ spectra of the aircraft system and its environment 
whiA are available to and sensible by the pilot. The ability of the 
human to discriminate changes within each energy spectrum is then 
examined to determine those cues in the environment v/hich the pilot 
could use for aircraft control. Following the specification of physical 
energy spectra, it is necessary to detemrme which cues are actually 
used for control. This approach was deemed to have utility in 
examining the auditory cue problem. 

The second analytic basis for specification of cues was considered 
in terms of infomation displayed as an array of cues, or the 
information array approach. This approach was deemed to be most 
useful in postulating cues in the visual, motion and control movement 
areas. VJith this approach, rather than beginning with a specification 
of the physical energy spectra, postulations are made as to which 
cues are present and needed for control and then the stimuli are 
sought whicli give rise to these cues so that they may be described 
and quantified. It should be remembered that both approaches are 
aimed at identifying and describing the physical, quantifiable 
parameters which provide stimulus sources "for the cues. The stimulus 
environment approach is employed by describing the whole of the 
physical environment and distilling from it those stimuli which 
provide the basis for aircraft control. The information array 
approach is employed to postulate the cues which are present and 
used by tl)e piDot in control folloi*;ed by a specification of the 
physical stimuli viiidi provide these cues. 
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2.0 VISUAL CUES 



2.1 lOTRODUCriaJ 

In Chapter 1.0 an analytical approach was adopted which develox;ed 
a taxonony for classifying cues within diinensions of aircraft control. 
In this chapter visual cues are postulated within the framework of 
the taxonony and experiments ara recommended for testing the validity 
of the postulates. 

Several major questions relevant to the problem of the contact 
world visual cues in ground based trainers are considered here. These 
are questions of (1) monocular cues, (2) binocular cues, (3) display 
content, (4) color vs black and white, (5) displ^ field of view, 

(6) virtual imagery, and (7) visual image quality. 

2.2 BACKGROUND 

2.2.1 Referents and Controlled Indices in Visual Control 



A major consideration in the postulation of cues discussed in 
Chapter 1.0 was that, when cues for control are postulated, 5.t is 
implied that there exists a desired condition or standard to which 
system output is being compared or controlled. This standard was ) 

termed the referent. Control also implies a controllable index 
which the pilot seeks to maintain in some position relative to the 
referent. Therefore, in specifying cues to control, those elements 
in the stimulus which provide both the referent and the control 
index must be specified. Note that this would not apply to realism 
or masking cues. 

In the visual modality the referent or standard may be an 
identifiable element in the real world whose physical characteristics 
may be described as providing the stimuli for the cue, e.g. , the 
horizon line as a referent for aircraft. In the motion and auditory 
senses these referents may be more subjective in that they are 
remembered standards for which the objective real world stimulus 
elements are not always present v?hen control judgments may be made. 

The visual judgment tasks approximte the subjectivity of the 
motion and auditory tasks under those conditicns in which a rate 
must be remembered or the controlled index must be kept in some 
learned juxtaposition relative to the referent standard. Under these 
conditions a controlled index may be required to be placed in some 
relation to an external referent. For exanple, it may be necessary to 
keep the nose of the aircraft a certain distance below the horizon for 
level flight. Thus, in .contact flight the relationship between the 
standard and the controlled index may often be a learned and remembered 
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Gcparation distance rattier than a super-imposition of indices. As such, 
this relationship is subject to forf^etting and, over a period of 
operation, subject to drift in much the same manner as auditory 
standards drift. ITiis drift of the visual referent has been 
demonstrated by Thielges and Matheny (1966). It is inportant, 
therefore, in identifying the referent and the :ontrolled index that 
the spatial relationship between these two be identified and made 
explicit. 

Another important consideration in the postulation of the cues 
and the interactions among cues between the various sense modalities 
is the dwamic aspects of the stimulus energy vjhidi gives rise to 
the cues. The position of the ccntrolled index relative to the 
referent is irrportant but of equal iirportance are the time derivatives 
of that position. Ihe learned rate of movement of a physical element 
may serve as a standard against wliich the rate of a controlled 
index in judged and controlled. The rate of movement of the nose 
of the aircraft around the horizon or the rate of f lc^7 of ground 
beneath ttie aircraft may serve as irrportant cues for various control 
decisions. It should be noted that x^7hen the task is control of the 
rate of movement of an element through use of the visual sense, the 
standard or refex'ent may be required to be stored and is subject to 
the same problems of drift as are the more static referents in the 
motion and auditory senses. 

2.3 MOHOajlAR CUES 

2.3.1 Perspective Geometry as a Useful Descriptive Method 

One of the difficult problems in TXDstulating visual cues is the 
setting uj:> of a set of constructs vjhich operationally and rigorously 
define the visual world scene and can be systematically varied in 
order to determine the effect of variations upon operator performance. 

An opei'ationally defined set of constructs could be generated from an 
examination of the pure physics of light and the visual discrimination 
ability of.ttie human, i.e. , the stimulus environment approach 
discussed in Qiapter 1.0. That approach to the identification and 
specification of the visual cues was found to be rather sterile in 
that the microscopic examination of visual stimuli did not lead to 
postulates as to how the pilot perceives and obtains information from 
the real world for control of his aircraft. 

The information' array approach has proved more productive of 
postulates provided the requirement is kept clearly in mind that the 
stimulus energy giving rise to any postulated cue must be stated in 
explicit quantifiable terms. This approach draws upon the visual 
perception literature and upon the experiences of the investigators, 
pilots and users of trainer visual attachments for postulates as to 
visual cues for aircraft piloting. Consideration of the information 
from these sources centers attention upon the role of monocular 
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cues in aircraft piloting. It in important to examine the role and 
the. adequacy of monocular cues for based trainers because of 

the relatively simpler equipment problems in generating monocular 
displays compared to binocular displays* Further, if monocular cues 
can be found effective for control and for training, sirrple 
perspective or picture plane geometry describi.'ig the single eye scene 
may be applied to the problem of cue description. 

Ihe monocular cues coimionly listed (Graham, 1966) are (1) 
relative size, (2) interposition, (3) linear perspective, (4) aerial 
perspective, (5) monocular movement parallax, (6) light and shade, 
and (7) acccfmiTKxjation. \*Jhile these cues are proposed as being those 
which allow for judgments of depth or perception of space we are 
interested in a set of cues whic)i allows the pilot to do more* He 
must not only ma]^e judgments as to depth or distance but must make 
judgments with respect to the attitude and position of his aircraft 
v;ithin that space. Ihus, those cues which serve as referents and 
control indices which en^le him to make judgments as to attitude 
and position as well as distance are necessaiy". 

Examination of the list of mcnocular cues given above leads to 
the conclusion that, with the exception of light and shade and 
accomiTKxlation , the perspective geometry methods are applicable to 
their quantitative description. The use of such a descriptive method 
malces possible the quantitative specification of the position of 
points, lines, planes, and therefore objects, in visual space so that 
their number and relationships may be systematically stated and varied 
as independent experimental variables. In particular, it allows for 
.the expression of the relationship between referents in the 
geometrically descril-^ed real world visual space and the indices which 
are a part of the aircraft being controlled. 

The important consideration would appear to be that a perspective 
geometry analysis is an abstract method of mathematically treating 
retinal stimulation which can prove useful in programing on a two 
dimensional display the visual cues derived from a three dimensional 
scene. Ti\e analytical treatment of these cues must necessarily be 
limited by the basic assumptions underlying the perspective analysis 
method. 

A rloscriDtion of the application of perspective geometry to the 
problem of cues to aircrcift landing is given by Bell (1951). An 
intensive analysis of its applicaticn to the cues to control of the 
helicopter during hover is reported in Matheny and Thielges (1965). 
These reports demonstrate the manner in which a perspective analysis 
is useful for napping the visual area available to the pilot, for 
describing the relationships arrv.)ng objects, and calculating rates of 

movement as a function of the angle of regard for given dimensions of 
aircraft control. 
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2.3.2 llio Adeauao/ of Monocular Cues 



itefore postulating a set of jnonocular cues for the pilot and 
the adoption of perspective geometry as a dimension along which they 
may be dcscrilxjd and varied, the literatm-^ dealing with binocular 
and monocular c\ies to depth perception as it pertains to piloting 
v/as examined. 

adoption of a perspective geometry approach for the two 
dimensional description of she three dimensional world sets certain 
bounds upon the cues v;hidi can be postulated within this framework. 

That is to say that perspective geometry does not consider other 
dimensions of visual perception such as color, brightness, or 
attenuating factors. (These dimensions are considered later in this 
Chapter.) Within the perspective geometry framework, however, a 
multitude of postulates as to relevant cues may be made, tested, 
and used as the basis for trainer visual attachment specification. 

As a prelude, the literature supports the conclusion that, in 
those situations in which the aircraft pilot is required to exercise 
control using visual cues, monocular cues are sufficient for most 
conditions of control. One of tlie earliest to concern himself with 
the problem of monocular and binocular cues was VJoodworth (1945). 

He concluded that "except for close work, the manipulation of small 
objects right befor'e the eyes, binocular cues are probably less 
impx:)rtant than covering, shading and the different kinds of perspective." 

l*he literature dealing specifically vjith the control of aircraft 
under both binocular and monocular conditions suggests also what 
might be predicted from the results of laboratory v;ork. That is, 
any superiority of binocular over monocular discriminations is most 
evident for near objects and decreases to equality at distances at 
which most visual discriminations are made by pilots. (Hirsc±i 5 
VJeymouth, 1947; Graham, 1966, pp. 525). 

In the introduction to their recent study Lewis and Krier (1969), 
report soire interesting statistics provided by Dr. Stanley Mr^hler of 
tlie Federal Aviation Administration. These statistics from FAA files 
indicate that during the last five years no one-eyed pilot has been 
involved in a flight accident related to vision even though more than 
2600 were flying of 10 I^oeiriber 1968. These data support the 
"Wiley Post"! type of anecdotal evidence in support of the adequacy 
of the monocular cues for aircraft control. It is interesting, hewever, 
that such a large number of pilots are currently carrying out accident 
free flying using only rronocular cues. 



1. It may be necessary on this, the 35th anniversary of his death, to 
point out that \7iley Post-^was a famous one-eyed pilot of. the 1930 ^s. 
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The Lev;is and Krier study deals directly with the question of the 
adequacy of monocular cues for aircraft piloting. In this study 
pilots flcv7 the jet trainer during a series of touch and go landings. 
Landings were carried out with ful] binocular vision followed by 
landings with fii?st the left and then the right eye covered. No 
differences v;ere found in performance across these conditions v/ith 
respect to measured longitudinal deviation from a specified touchcewn 
point. Lifferences were found v.dth respect to airspeed control, sink 
rate and approach angle. Under rronocular conditions the pilots tended 
to fly steeper anprcaclies than under binocular conditions, although 
none of the pilots were aware of this at the tine. The steeper 
approaches were reflected in differences in airspeed, sink rate and 
apnroadi angle. 

In a study carried out by M/^A and discussed by both Perry et a\ 

(19G7) and Roman et al. (1967) pilots flew the T-33A aircraft to 
successful landings v;ith such a narrow horizontal field of view that 
stereopsis could not have been used during the landings. There was, 
however, no significant decreinent in pilot performance as the visual 
cues changed from birocular to monocular. 

Brown (1970) measured the performance of two pilots during 
twelve approaches v;ith binocular and twelve approaches with monocular 
vision during ni^t landings. Measures of performance were rate of 
descent at toudidown, distance beyond the ILS transmitter at touchdown, 
lateral velocity at touchdotvn, and bai’ik angle at touchdown. The 
autliors report the use of monocular vision at nd.ght, while causing 
changes of flight technique, did not generally produce poorer landing 
performance. 

VJilkerson and Hatheny C 1961b) found that in hovering a helicopter 
there was no difference with resj^ect to average altitude error between 
the monocular and binocular conditions. Ihere v/ere, however, 
significant differences in the control of lateral and fore and aft 
translation. 

In an early study by Pfaffmann (1948) experienced Naval flight 
instnictors carried out a series of landings while wearing special 
goggles which cut out the binocular stereoscopic field of view. The 
evidence from this study shos^jed that the removal of binocular visual 
cues impaired the landing performance by introducing a constant error, 
i.e. , the tendency to level off too high. As in the Lewis and Krier 
study there was some tendency to approach too high. This problem was 
accentuated h; the fact that there was a tendency to crewd the downwind 
leg closer to the field because of a feeling that the size of the objects 
and buildings around the field appeared smaller under monocular conditions. 
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Thi' ntuciicG of Brictson (1966) are relevant to the question of 
Tir)noc\i].ar versus binocular cues. A large nunter of carrier recoveries 
(landings) wen: carried out both during the day and at night. Under 
night time conditions the pilots were operating under conditions in 
which binocular cues were reduced. Pilot performance during day 
and night landings were found to be different in terms of altitude 
errors wliile lateral errors were essentially the same for the two 
conditions. In general the pilot tended to approach slower and higher 
and to land harder and shorter by day then by nij^it with greater nigjnt 
performance variability in all measures* 

The early work of Roscoe (1948, 1951) is relevant to the 
problem of binocular versus monocular cues. In Roscoe’s first 
experiment (1948) pilots made landings to a spot using a periscope 
display v;hidi presented the information to the pilot on a flat plate 
display of restricted size. In this experiment, althou^ the pilots 
could successfully acconplish the landings, their performance was 
significantly vjorse under iTonocui.ar conebLtions than when their view 
vjas unrestricted and binocular. Roscoe attributes these differences 
to the combined effect of the loss of binocular cues and restriction 
in total visual field. In his discussion of the results Roscoe states 
"it is possible that tlie binocular depth cues as such are of significant 
importance. Ihis could tested early in another experiment simply 
by covering one eye and comparing the accuracy of the landings made 
in this condition with results from the condition ’C’ (the un- 
restricted binocular condition). It is doubtful that the difference 
v/ould be significant." 

In a later experiment Roscoe (1951) compared performance of pilots 
in flying the "oboe" flight pattern using a ti70 dimensional "periscope" 
to flight using the unrestricted contact display. As one of his 
primary conclusions Roscoe found pilot performance v;ith an eight indi 
square "periscoDc" display not to be significantly different from that 
achieved under conditions of contact visibility* 

In one of the fevj transfer of training experiir^nts relevant to 
the problem Payne, Dougherty, Piasler, Skeen, Bra-jn and VJilliams 
(1954) used a tv-Jo dimensional landing display in which a perspective 
projection of the runway was viov;cd by the experimentai. subject as a 
projection on a translucent screen. Ihie perspective projection of the 
runway varied as a function of the aircraft’s heading, altitude and 
distance from the runv;ay. Y^ayne et al* found that this display system 
gave the pilots no cues as to v;]ien to start their round out or to 
accomnlisli their touclKlov^n. Therefore, the device was used only to study 
transfer of training in making an approach to landing in the SNJ aircraft. 
Students v?ere alJ.awfid, h.a-7Gver, to continue their anproach to a touchda^Tn 
during tlioir tronsfer trials in the actual aircraft. Ike results shotved 
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that the students who were trained using the two dimensional landing 
display required 61% fewer trials in the aircraft and made 74% 
fewer errors than did the students who did not use the device. The 
authors enphasize that the device should be used as a medium for 
principles training. By this they mean that the device is regarded 
essentially as an analog of the final task. An important part of 
the technique of using it is making the analogy clear to the student. 
The tedmique attempts to iiidoctrinate the student in the variety of 
relevant cues or "signals" during the course of the task, and to 
make clear to him what constitutes a correct sequence of conditions. 

The point is mde that when a device is used as a principles trainer 
it may depend less heavily for its success upon faithful simulation 
of the final task thcin does a device simply used as a task sample. 

Finally, we may cite the ccnclusions of Cibi.s (1952) as follcws; 
tl) the most reliable visual perception of space is obtained by 
observing an unobstructed hcnogeneoiis surface with simultaneous 
action of stereopsis, linear perspecti'/e and motion. (2) Sterecpsis 
associated with linear perspective by exclusion of the cues derived 
from motion yields almost the same degree of reliability. (3) 
Stereopsis without the effectiveness of linear perspective but with 
cues resulting from motion is less reliable than linear perspective 
under monocular test conditions. (4) Depth perception is least 
reliable under conditions involving motion but excluding linear 
perspective and stereopsis. 

Of particular importance is conclusion (3) in which the importance 
of linear perspective would appear to be emphasized and is fundamental. 

Summarizing the literature it is apparent that, althcu^ the 
evidence is not always clear cut in favor of monocular cues, it does 
support the notion that a profitable area of research would be to 
determine that set of necessaii/ and sufficient monocular cues which 
the pilot can and does use in controlling his aircraft throughout 
the several dimensions of control. We should hasten to point out 
that the evidence for the utility of mcnocular cues lies in those 
perceptions in which the stimuli are distant from the observer. In 
certain piloting tasks such as hovering the helicopter in which 
stereopsis might be quite beneficial the evidence is somewhat equivocal 
(see Wilkerson £ Matheny, 1961b). This is discussed in imore detail 
in Section 2.4, Binocular Cues. 

Within the framiework of perspective geometry, cues may be 
postulated through explicit statement and tested by observation of 
the effect of their being varied upon pilot ccntrol behavior. For 
example, the relationships among points, lines, planes or solids which 
provide the cues to height and distance from a point on the ground 
may be stated explicitly. 
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Usinp: this frame of reference, postulates as to mc^nocular cues 
for control of aircraft attitude and position in space have been 
TOde and are contained in Appendix A. 

2*4 BINOQJLAR CUES 

It was sup,gested in the discussion of monocular cues that most 
visual cues used by the pilot are beyond the range at which binocular 
cues could be used. \^ile, as c. general finding, the literature 
supports this suggestion, there is evidence that in certain tasks the 
pilot may make use of near distance information in which binocular 
cues are used, if not as primary cues, at least to serve to increase 
tlie accuracy of near distance perceptions. For exairple, Wilkerson and 
Natheny (1961b) and Brown (1970) found that variability in performance 
increased significantly during conditions of monocular cues over 
that duT'ing binocular conditions althou^ average level of performance 
was not different. In both of these studies near distance cues could 
be involved since Matheny and Wilkerson studied helicopter hovering 
and Brown studied aircraft landings. In Brictson’s work (1966) 
with carrier landings the greater variability in altitude error under 
night (monocular) caiditions is also evident. 

(Iraham (in Stevens, 1951) indicates that convergence as a cue is 
not effective beyond about 20 yards. Stereoscopic vision using disparate 
images has a theoretical limiting range of about 495 yards. Hcwever, 
these values have not been outstandingly helpful in making decisions 
about visual attachments. 

The usefulness of near vi.sion binocular cues for the task of 
helicopter hovering should be established for guidance in future 
trainer design because of the criticality and difficulty level of 
that task (Matheny 6 Wilkerson, 1965). Research on the problem 
should establish the contributions of binocular cues to performance 
and the degree of transfer from the monocular training conditions 
to the binocular operational work. It is believed that equipment 
suitable to the conduct of this resecirch is available in the tethered 
devices such as the Jaycopter and the Whirlymite* Descriptions of the 
reconmended research are given in the following Sections. 

2.4.1 Racomrrended Research on Near Distance Ores. 



A tethered helicopter type device such as the Jaycopter allows 
enough freedom of movement and opportunity for performance recorxiing 
to carry out useful research on the altitude visual cue problem. ' 

I'lost inportantl^/ it provides the motion cues coincident with the 
visual. As a criterion device it is relatively lcxN?-cost and 
manageable as a research tool. 
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Tlie experimental question to be answered is the value of the 
binocular visual display over the monocular in the ground based 
trainer. The experixnental Vt-iriable may be varied throu^ requiring 
the subject to perform the hovering task, both binocular ly and 
monocular ly. Using the time savings transfer paradigm in v^iich time 
to reach criterion by an experimental group is conpared to that 
required by a control group, the monocular ly trained group would be 
treated as the experimental group. After training to criterion in 
holding altitude and groiAnd position they would be transferred to the 
criterion condition in which they iDerform binocular ly. The control 
group to v^ich the experimental group is coirpared, learns the task 
to criterion using binocular vision. 

The Jaycopter as a research tool may be adapted also to the 
investigation of other visual cues of inportance to ground based 
trainer design for near distance tasks. For the hovering task the 
variables of display content and extent of visual field may be 
systematically investigated. The study of display content requires 
that an enclosure be constructed about the device upon which may be 
placed the picture plane representations of the real world objects 
in accordance with the rules of perspective geometry. The enclosure 
surface must be capable of being changed from a flat to a curved 
display surface. A floor must be constructed under the device upon 
which ground "texture” may be represented. Content of the display 
may be variable in providing (1) attitude referents, i.e. , horizon 
line and ground plane (2) altitude referents, i.e., objects on and 
protruding above the ground plane and (3) ground position referents, 
i.e., objects on the ground plane. The postulates and laboratory 
findings of Matheny and Thielges (1965) with respect to external and 
internal referents may be tested with such a device. 

Research bearing upon the question of hot; visual space may be 
best described for aircraft control may be jxDssible of being under- 
taken in the tethered helicopter device. This research is ccncemed 
with the considerations raised by Luneburg (1950) and Blank (1959, 

1961) as to hew visual space is best represented. These considerations 
may be important to the design of ground based visual attachments. 

As viewed by Luneburg and supported by Blank, visual space is best 
described as Riemann3.an space with constant Gaussian curvature. 

It is recommended that an intensive investigation be made of the degree 
to which the tethered helicopter with appropriate curved and flat 
display surfaces can be used to test Luneburg’ s theory of visual 
space under dynamic viewing conditions. 

Another most irrportant area of investigation is that of the 
utility of binocular cues in judgments of altitude wlien the observer 
is moving approximately parallel to the ground at rates of speed 
representative of those just after round-out and before touchdewn 
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in fi>Ed wing aircraft* It may be hypothesized (and has been 
suggested in the literature) that the "rate of flow" of objects in 
peripheral vision is a necessary and a sufficient cue for altitude 
judgme-nts at this distance. 

l.he use of a light plane or helicopter to obtain quantitative 
compai?ison data between monocular and binocular conditions is 
recomnended. Hcwever, the appropriate textural content question may 
be raised particularlii’ by those ccncemed with ccuputer graphic 
display content generaticn. VJhat density, size and contour of objects 
constitute texture can be argued but will not be here. Bather it is 
evident that position and shape of textural elements may be described 
by the rules of perspective geonetry and varied as an experimental 
varialDle. 

As an experimental tool of general use in obtaining answers to 
neny '\/isual attachment questions, and the display ccntent question 
in particular, it is recommended that a model- terrain high-resolution 
television projection system be procured. Such a system has the 
flexibility required of a research device in that the terrain content 
may be varied systematically frcm "stylized" computer graphics types 
of displays to more real form types. Other capabilities of such a 
system for use in the study of other questions will be discussed in 
the sections to follcx-J. 

2.5 THE ROLE OF COLOR AS A VISUAL CUE 

Whenever visual cues to fli^t control are discussed or the 
requirements for visual attachments to ground based trainers are 
considered, color is nearly always advanced as being a parameter of 
importance in providing the operator with his necessary information. 

In addition to information concern with color as a cue, formal 
statements appear in such publications as Society of Automotive 
Engineers, Aerospace Information Report, AIR-771 entitled "Visual 
Simulation for General Flight Simulators/Trainer Attachments'.’. In 
this report the desirability of the additional cues furnished by color 
is stated. Ketchel and Jenney (1968) indicate that contact analog 
and terrain avoidance displays could profitably make use of color to 
improve perspective or to create quasi-three dimensional effects. 
Hoi-jever, there is no evidence to be found in the literature which 
indicates that color has any of these attributes. 

Concern with color as a visual cue to direct aircraft control is 
probably unjustified. Rather, when the role of color as a cue is 
considered it must be examined in terms of the indirect effect of 
sortE of its dimensions upon the perceptual judgments required of the 
pilot. To the extent that color improves ccntrast or apparent 
brif^tness it may influence judgments of distance. For exanple. 
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Taylor ,ind Sumner (1945) found that the bri^ter colors used in 
their experiment (white, yellow, and green) were judged to be nearer 
than the darker ones (red, blue and black). However, the lack of 
any evidence that color contributes to the j'odgments required of 
the pilot in controlling his aircraft leaves the problem of this 
dimension of visual cues in need of ejqjerimental investigation. 

The apparatus suggested in Section 2.4 in which a terrain model 
is used with a television pick up and T.V. projection display system 
makes possible the stucty of identical tasks in the simulator with and 
without color. It is reconmended that this dimension of visual cue 
encoding be of relatively low priority in view of the lack of any 
positive evidence indicating that color can be used as a cue to 
control. On the other hand, color will undoihtedly be felt to be of 
iiqiortance by users of the devices in order to add realism to the 
display with the resultant motivational value contributed by its 
addition. The problem of color must then be faced frankly as one 
in v^iich its utility as a cue to control must be established 
definitively. If it is fomd not to be a significant contributor 
to control it should be recognized as being used solely for enhancing 
the acceptability of the device. Whether acceptability of a device 
has a direct and significant effect upon the effectiveness of the 
device is another experimental question. This acceptability effect 
and its integrative effect upon motion cues is discussed in Chapter 
6 . 0 . 



2.6 VIRTUAL IMAGERY 

Proceeding with the argument that the majority of the visual cues 
of importance to the pilot are those which are at a distance sufficient 
to make them monocular iirolies that the lines of sight of the two 
eyes are parallel with id^tical images falling upon each of the 
retinas and that the viewed object is at virtual infinity. This 
set of circumstances has lead to the s\:qpposition on the part of 
some designers of ground based trainers that the visual scene of the 
pilot may be displayed as a virtual image, i.e., presented by seme 
form of collimated light system. 

Evidence wi.th respect to the advantages of such a system either 
in terms of more closely approximating the real world visual cues or 
as a contributing parameter to training devices is not available. 

Brewn (1970) found no differences in touchdown performance between a 
T.V. image viewed at 2 feet and an image created by a lens system 
which pr^uced a virtual image nearly 6 feet away. However certain 
questions may be raised with respect to virtual display imagery which 
need enpirical investigation. 
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One of the first problems is that in a collimated system all 
objects projected by the system presumably are projected at infinity. 
This may not be desirable particularly with respect to the j^round 
plane on vjhich viewed objects rest since this ground plane presumably 
extends from immediately below the individual to infinity at the 
horizon. Consequently, it is postulated that near points on the 
ground plane should not always appear at infinity. 

Another problem suggested with respect to virtual imagery but 
not verified conclusively during this investigation is that v;ith 
collimated systems of larger exit pupils the apparent distance of 
an object changes as it moves away from the central line of regard. 

That is to say that while an object viewed directly forward along 
the medial plane will be seen as being at infinity, as that object 
moves laterally in the visual field it will appear to come closer 
to the observer due to the optics of the system. Tne empirical 
investigation of these phenomena must be imdertaken and definitive 
data obtained as a first step in the investigation of the utility 
of virtual image displays. 

A sometimes bothersome problem which is becoming less of a 
nuisance with the advancement of the state-of-the-art is that of 
exit pupil size. Ho/ever, it v;ould appear that the exit pupil size 
is related to the problem mentioned alxDve in that if the exit pupil 
is small the apparent change in distance as a result of lateral 
movement in the visual field is less than when the exit pupil is large. 
Again, this is a question requiring empirical investigation. 

As a summary statement, it is recommended that the question 
raised regarding the relationship between the apparent distance of 
an object and its position in the visual field of a collimated 
display be investigated and empirical data obtained. Following these 
investigations the comparative effectiveness of using virtual imagery 
as opposed to flat plane tv;o dimensional projections for distance 
viewing should be investigated with flat planes positioned at near 
(less than 5 ft.) and far (greater than 20 ft.) distances. It is 
tlie hypothesis of these investigators that the differences would not 
be significant or practical and that the additional complexity of 
creating virtual imagery would be unnecessary. This hypothesis 
requires empirical test. 

2.7 FIELD OF VI^'J 

Tlie required field of viev; for the visual display or projection 
screen for a ground based trainer is a parameter that must be 
considered as dependent upon other parameters of the training situation. 
First of all, it is inportant that it be considered as a function of 
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the diinensian of control of one dimension of the vefdcle.. For exairple, roll 
may be more effectively obtained from one area of the visual scene 
than from another. Similarly, information with respect to altitude 
control may be obtained more effectively from one area of the display 
than another. These suppositions rest upon the assumptions made 
earlier in Chapter 1.0 that the relevant cues for control rest upon 
tlie existence of external referents on the ground plane or horizon 
and some perceived relationship of an internal referent on the wind- 
screen to that external referent. 

Matheny and Thielges (1965) developed a model whereby the 
precision of control for any dimension of control of the vehicle, 
e.g., the helicopter in hover, could be predicted as a function of the 
relative placement of the internal and external referent within the 
field of view. Exper5jnental evidence reported by Thielges and Matheny 
(1966) verified the model predictions with respect to the detecting 
of a d.isplacement of a referent v/ithin the field from an internal 
referent on the windscreen during the hovering of the helicopter. 

This model did not deal with detections of rates of change of the 
vehicle or the use of such rate information. 

A variety of reports provide evidence pertinent to the required 
extent of visual display. Roscoe's *Tlight by Periscone” studies 
(1951) show that, while performance varies as a function of the 
width of the display for very small displays, i.e„, fran 2 inches 
up to 8 inches, performance with an 8 inc±i square attitude display 
vjas not significantly different from that achieved with contact 
visil)ility. The description of Roscoe's apparatus indicates his 
8 inch sauare attitude display gives a field of view of plus or 
minus 15° laterally. 

Experiments conducted by T-latheny and Hardt (1959) using static 
displays demonstrated that the size of the display did not differentially 
affect the interpretation of pitch and roll in a contact analog 
display for display sizes of 4 1/2 inches, 11 1/2 inches and 42 inches 
square, V/ilkerson and Matheny (1961a) found also that there were no 
significant differences in attitude control of the helicopter during 
hover when using an 8 inch square display or vievjing the scene under 
full contact conditions. At the nominal viewing distance in the 
helicopter of 30 inches the 8 inch square display used by Wilkerson 
and I'latlieny would provide a viev‘7ing angle of plus or minus approxi- 
mately 7 1/2 degrees. 

With respect to the control of such aircraft dimensions as 
position relative to a point on the ground or judgments of altitude 
above the ground Roscoe measured performance in both right climbs 
and left glides vjhile Will<:ersan and Matheny (1961a) measured the 
ability of the helicopter pilot to maintain ground position and altitude 
during hover. Again an 8 inch square display was sufficient to provide 
the pilot x^;ith information which allowed him to perform as well as 
with the full contact vjorld viev;. 
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Considering the visual capacities of man, data relevant to his 
visual acuity as a function of angula'” distance from the center of 
the fovea (Graham, 1966, pp. 329) indicate that increasing the 
lateral dimension of the display beyond approximately plus or minus 
5° would bring about no significant change in the operator's abilities 
to detect changes. However, when one turns his attention to the 
other component of the system, i.e. , the dimensions of movement of 
the vehicle, it can be demonstrated that there is a direct and relevant 
relationship between dimension of control of the vehicle and the 
dimensions of the visual display. This is best demonstrated by 
considering first the dimension of ccntrol of pitch of the vehicle. 

It can be seen that, if the horizon line is used as an external 
referent and a point on the windscreen of the vehicle is used as an 
internal referent, a very narrow forward vievj is sufficient for 
detection of pitdi changes. The width of the forward view would have 
no effect upon the relationship between internal and external referents 
with changes in pitch. However, when the control of roll is 
considered it is apparent that a ver^; narrow forwarcl view using the 
/lorizon as a referent and a point on the windscreen as an internal 
referent would give little informatics vdth respect to roll. As the 
width of the viev;ing area is expanded the linear displacement between 
the horizon and any given internal referent would increase for any 
given angle of roll. Thus, the gain (K) of the display with respect 
to the roll dimension is increased with the increased width of visual 
display. 

The model developed by Matheny and Hiielges (1965) describes 
the relationships between dimensions of control of the vehicle and 
placements of the internal and external referents on the X and Y 
coordinates of the visual display. The model demonstrates that 
different areas of the visual field are more effective for providing 
information for the several dimensions of control of the vehicle. 

lilhile it has been demonstrated that the ability to detect changes 
and to effect ccntrol of the various dimensions of the aircraft are 
a function of the size of the visual display, the evidence would 
indicate that the size is not a critic:al problem for detection of 
displacements. It may be postulated, however, that the rate of flow 
of informaticn as detected either foveally or peripherally is an 
inportant cue for the judgment of altitude above the terrain. This 
has been suggested by Calvert (1957) as his "parafoveal streamer theory" 
in vAiich judgments of rate of closure and altitude (particularly 
with respect to glide path) are a function of the flew of objects 
past the observer as he approaches the ground plane. The experimental 
question is whether or not the flew of visual stimuli at the 
periphery provides the useful cue to the judgment of altitudes during 
tasks such as landing or lew altitude flight. The important variables 
for these judgments are suggested as being the extent of the size of 
the solid angle of the visual display, i.e., the area of peripheral 
visicn, and the configuration of the ground plane, i.e, the density 
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and shape of the "textural" elements which define the ground plane. 
Research relevant to this problem is very much needed. 

A problem which may be raised and which should be considered 
here is that of the "minification" phenomenon first suggested by 
Ptoscoe during his periscope studies. Roscoe observed that when 
objects were observed through a lens system with projection on a 
flat screen of limited dimensions (8x8 inches) their judged size 
was smaller than when observed under contact conditions. This 
minification effect has not been explored to determine whether it is 
a function of the tv/o dimensional projection or the size of the 
surround or sane interaction of the two. Although it may possibly 
have an effect upon the perceived size of objects projected on a 
visual attacPiment to a ground based trainer, it is believed that with 
the screen sizes involved minification is not a problem. 

2.8 VISUAL IMAGE QUAUIY 

The term image quality is used here to cover characteristics 
of the displayed image suc^ as resolution, contrast and acutance. 

These measurable aspects of the image may be related directly and 
predictably to ]^rceived size, or relative position distance of 
objects within the display. The problems of defining the criteria 
for the physical characteristics of a visual display in meaningful 
and relevant terms have been discussed ty Rosendahl Q°68, 1969) 
and Haldonato (1968). These are problems which are ti?uly psycho- 
physical and require for their solution the cooperative effort of 
physicists and psychologists. 

The measural-)le image quality of apparent most concern is that 
of resolution judging frcm the space devoted to i.t in the literature. 
Wiile resolution, as a quantifiable and measurable parameter of a given 
displayed image, is an important dimension of the visual display 
little is known about what optimum or minimum resolution is necessary 
for any given training device. Nor is it known hew display resolution 
interacts with the content of the display or with other display 
parameters to influence the training effectiveness of the device. 

Such question are raised and discussed by Oharek (1967) and by 
Aronson (1968). 

A dimfinsion of visual images which may interact importantly 
with judgnents of depth or distance in a display is that of the 
acutance or the sharpness of edges within the displayed image. This 
concept has been discussed by both Rosendahl and Maldcnato, (ibid). 

This "density gradient," as it were, at the edges of objects making 
up the content of the display may be hypothesized to have a pronounced 
influence upon judgments of relative distance between objects or of 
distance of objects from the observer. Hew the acutance Vcilue may 
be modified by di.fferent figure-ground brightness or color contrast 
ratios is another interesting and unejpilored question. 
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Although resolution, acutance or contrast ratio per se within 
a display may not properly be considered as cues to ccntrol in the 
sense wc have been using that term, it is inportant that their 
interactive effect upm cue identification and discriminaticin be 
considered. 

2.9 UNUSUAL VISUAL CaiDITIONS 

A ground based trainer can be visualized as being used in such 
a way as to provide training by presenting first the essential 
relevant cues for nornal fli^t and gradually complicating the cue 
discrimination task throu^ the intrcxiuction of noise or masking. 

This gradual increase in the requirements of the task should include, 
at its final level of difficulty, the visual perception task which 
requires the pilot to perform under unusual and stressful conditions 
or high work loads. 

One of the most common of the "unusual" conditions is that of 
the requireii-snt for the pilot to make judgments with respect to his 
spatial position and vehicle attitude upon breaking from IcHf? ceiling 
conditions with limited runway visibility. The variables of the 
visual display discussed in the previous sections should be 
investigated with respect to pilot performance under these unusual 
conditions and of breakout from instrument to contact flight. The 
importance of being able to train in this task in the simulator rather 
than the aircraft is evident. 

A further unusual condition V7hich requires investigation is the 
interaction of the parameters of the visual display with the motion 
cues with the result that the pilot becomes disoriented. This inter- 
action is discussed nvore fully in Chapter 6.0, Interactions Among 
Cues. 
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3.0 MOTia^ CUES 



In consonance with the purpose of the project of providing an 
analytic basis and experimental designs for the conduct of research 
on multi-sensory cueing, postulates as to cues to motion along with 
reconmended research are presented. Postulates as to cues are based 
upon considerations of the results in the physiological j psychophysical, 
and behavioral sciences literature. The findings in these areas have 
been brought together to form an inportant background for the under- 
standing and justification for the postulates presented. Experiments 
are outlined whicii are designed to test the validity of the 
hypotheses and lead to their verification or modification. Consideration 
of the physics of motion and a description of how the motion 
characteristics of objects may be expressed has been important 
to the formulation of a precise description of motion as an 
independent e>perinr.ntal variable. 

In order to determine the cues which conprise the motion infor- 
mation array it is necessary (1) to deliberate the functional role 
of motion recepticn in the human, (2) to examine what is presently 
known ccnceming the h.uman motion sensory receptors and (3) to 
speculate on control laws which govern the interaction of these 
receptors, the perception of motion and the resultant reaction of 
both the moticn perception and reflexive responses. The elements 
(1), (2), and (3) constitirte the bases for the building blocks of 
the control systeiTi. In order to prod\ice an output from any system we 
must }iave an inj^ut forcing function. Hie output will be a result of 
the input to the system and the manner in whidi the system operates 
upon tlic ;ijiput. Since the huran piloting an aircraft is placed in a 
motion environment sorreewliat dissimilar from that of self locomotion, 
the effects of such a dissimilarity upon motion perception should 
1)6 discussed. Figure 3-1 illustrates the outline of the Sections 
3.1 - 3.3 of this Qiapter. i.hrd;ain research hypotheses concerning 
the implementation of motion cueing in flight simulators are derived 
from tliese deductions concerning motion perceptions. 

In Sections 3,4 and 3,5 motion as an experimental variable is 
described in terms of its mathematical expression and hew it can be 
manipulated as an experimental variable. In Section 3,6 experimental 
v7ork and the requirements for equipment capability and calibration 
are outlined. 





26 



NAVTl^ADI :va:N- 6 a -C-0 30 4 



r* 1 




I I 

Motion Receptors 



Figure 3-1. The Motion Perception System. 




3.1 nJlJCTIOIJAl, ROLE OF MOTION RECEPTION 

Hie percept.ion of the movement of the organism v;ith respecrc to its 
environment involves a complex interaction of many receptors distr5.buted 
throughout the l»dy. Altliough consideration of the interaction with the 
visual sense is basic to the understanding of the flo; of pliysical 
orientation data witliin the organism, it is instructive to exaimine the 
functioning of the iroti.on receptors in the absence of tlie visual feed- 
bad’; loop. In this Sootion this function is analyzed and described. 

i'eriiaps tlie most basic concept of the functional basis for 
reception of movement of all or part of the body is that it is for 
nostural staliilization and locomotion. Tliese ti«Jo principles (postural 
staliilization and locomotion), alti\oup)i on first imiiression apparently 
onposite in nature, are truly extensions of one another. That is, 
locomotion is aocomniislied by an alternative unbalancing to produce 
momentum and rebalancing of the body about a nev; point of staloilization. 
Extensive studies of the vestibular system indicate that this system 
plays a Icarge role in sensation of deviation from the apparent vertical. 
Hiis role is far from exclusive, hov/ever, since the neck joint receptors 
also appear to malce a higfily significant contribution to the receptors 
of notion, particularly to the conscious avjareness of motion. 

V/e may postulate that the experienced pilot tends to viev7 the air- 
craft which he controls as an extension of himself. In this sense 
we may use the concept of the aircraft as an "exoskeleton" witli the 
pilot contained in tt\e "coelomoid." The concept of the vehicle ^ 
an exosV.eleton of the pilot may be inferred from the work of 
investigators of human describing functions, the results of wMch 
have indicated that the cembined describing function, Yp Yc, is 
adjuste(i by the pilot in a gener£illy predictable manner. In these 
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experiiffints, the terms Yp and Yc are used to indicate the cascrdbing 
functions of the pilot and the controlled element (such as the air- 
craft) , respectively. In other words the pilot-vehicle combination 
becomes the essential unit. Ihis recent (in the evolutionary sense) 
exoskeleton has perforroance capabilities not corrpletely compatible 
with the sensory apparatus which has evolved in man in the course of 
time. For the visual sense this lack of compatibility has been 
corrpensated through the design of fli^t instruments as visual aids. 
However, except for the kinesthetic cueing through the control feel 
system, man must rely upon the responses produced by his natural 
unconpensated sensory receptors for bocfy motion information. 

The second basic function served by perception of movement of 
the bocty is to produce a relatively stable image of the visual scene 
upon the retina. Meiry (1966) studied extensively the effect of 
stimulation of both the vestibular apparatus and the neck proprioceptors 
upon oonpensatory eye movements. Both of these functions have been 
shown by Mayne (1965) to be matched dynamically to the frequency 
bandwidth of the natural movements of several animal species. The 
conclusion may be drawn that a large percentage of disorienting 
phenomena occur when the displacements to which the animal is 
subjected exceed in magnitude, frequency or both, the ’’evolutionary 
design" limits of the motion sensitive organs. Although aircraft 
have been basically designed for the capabilities of the human, 
there are many motions of the aircraft beyond the realm of "natural" 
human movement. Exanples which can be cited are the lar^e excursions 
in the vertical dimension or the slow, continuous turns with 
prolonged apparent vertical misaligned with the inertial gravity vector. 

3.2 THE MCiriOM RECEPTORS AMD RECEPTOR INTERACTION 

3.2.1 The Non-Visual Receptors . 

In the literature ccncemed with the role cf motion in aircraft 
control the weight of investigation has been placed upon the role of 
the labyrinthine receptors. The structure and function of these 
devices are apparently so well understood that a high degree of 
accuracy has been developed in their mathematical description. 

A mechanical analog of the vestibular system has been built (Young, 
Meiry, Nevmian, S Feather, 1969). 

While such an effort is commendable, it may be that such emphasis 
on a particular system has led to the disregard of other sensory 
mechanisms which could be equally important to the perception of 
necessary motion cues in aircraft ccntrol. If these other sensory 
systems are overlooked, the influence of their dynamic range is, 
consequently, omitted from analysis. It is a good design principle 
to matcJ-i the frequency bandwidth of receiver to signal if distortionless 
reception of a signal is desired. Consequently the inference that 
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has been made that a moticn signal produced by a simulator platform 
should match the bandwidth of the semicircular canals may be only 
partially correct. 

Roberts (1967) has presented a conprehensive treatise on the 
qualitative interaction of the otoliths, semicircular canals, 
and neck proprioceptors in relation to the postural muscle response. 

He has illustrated that the orientation of the head (and as a result 
the vestibular system) is not solely responsible for the resultant 
reflex. It appears that the head-neck-trunk relationship considered 
as a iffiit determines the reflexive balancing reaction of the animal. 

The nature of the postural reflex is thought to merit sv±)stantial 
consideration; it is postulated that it is througii the activation 
of the pestutral reflex system that major contribution of motion to 
aircraft control precision is made. If this is so, it is irrperative 
to consider sojie of the aspects of this system, the interactions of 
its elements as well as the components themselves. ITie ultimate 
objective of the understanding of tlie system would be to be able 
to utilize the response to stimulation of certain portions of the 
system to provide motion cues in the flight simulator rather than 
(as is presently the procedure) reproducing the angular and linear 
accelerations present at the pilot’s station ir flight. An 
interesting initiation into development of a model of the postural 
control system has been made by Gibson, Edgerton, Haskell and Hill 
(1969). A set of perturbation equations, based upon LaGrange’s 
equation for a seven element (head, trunk, thi^, shank, foot, 
upper arm and fore arm) stick man in which each joint is torqued 
proportional to the joint angle and angular rate, has produced a 
reasonable approximation to the postural response. The control 
law which was used, (i.e., that tte torque applied to each joint is 
proportional to the joint angle and angular rate) is based upon a model 
suggested by Stark (1966) and modified by Agarwahl, Gottlieb, and 
Stark (1968). In this model the afferent impulse rate from the 
mu! 3 cle spindle is shown to be proportional to muscle spindle 
length and stretdi rate for a significant frequency range. Althou^ 
the validity of such a control law for all the joints in the postural 
system remains to be established, it appears to be sufficiently 
reasonable to form the basis for some experimental h^/potheses in 
motion perception and in control movement cueing. 

The physiology of the vestibular system indicates that the 
relative roles of the utricle and semicircular canals are the 
sensing of linear acceleration and angular velocity respectively 
(over a specific bandwidth). Roberts suggests that the role of the 
canals is to provide velocity feedback to increase damping of the 
motion of the skull in inertial space rather than as a medhanism 
to provide information caioeming the angular velocity of the 
animal, per se. 
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The fac± that the head-trunk relationship is such a significant 
one suggests that those elenents which tend to produce not only 
variation in labyrinthine input signals but also variations in the 
relative position of the head to the trunk (hence the stretch of the 
neck muscles) should be examined. It has been iirplicit in many 
investigations that the body is to be considered a rigid mass so 
that accelerometers placed near the pilot's normal head position 
would indicate the acceleration signals irrparted to the vestibular 
system of the pilot. One need CHily relax the neck muscles and 
inpart a pulse to the bocty so as to sli^tly displace the head to 
observe how loosely the head may be articulated with respect to t)ie 
trunk. It is the pension of the neck muscles which maintains the 
balance of the hea^. The increasing tension of the muscle can be 
shown to have the 4nalogous effect of stiffening of a spring in 
that as muscle tension increases the natural frequency of a spring-mass- 
danper system increases (Agarwahl, Gottlieb, and Stark, 1969). 

Support of the skull throufd: tension of the neck muscles is a 
continuing process unless the individual is at rest. A change in 
acceleration will alter the load on these muscles, causing the skull 
to rock. This generates angular accelerations which can be detected 
by the semicircular canals, linear accelerations which generate a 
stimulus to tl’ie otoliths, and changes in muscle tension in the neck. 
Through this rocking mechanism the otoliths become useful in detecting 
linear accelerations applied to the body as a whole. From the 
cordiination of signals from all of these receptors the perception 
of both magnitude and direction of imbalance must be derived. It 
is not kno/n hc^: these sensors interact or the relative speed of 
signals reception from each. As previously mentioned the dynamics 
of the labyrinth have been accurately determined. As Mayne (1965) 
has suggested, the "natural" body movements of the human are 
approximated by the bandwidth of the semicircular canals. The 
electro-mechanical model designed by Young et al. (1969) is based 
upon the following experimentally derived bandwidths: 

Canals - 0.1 to 10 rad/ sec 

Otoliths - 0.1 to 1.5 rad/sec 

If indeed, as Roberts suggests, the canals function as rate feedback, 
the bandwidth of recepticn of acceleration is increased at the upper 
end. In addition, if the model parameters measured by Agarwahl 
et al. (1968) for the spindles of selected muscles of the cat can 
be hypothesized to be simi.lar to those in the human neck mtuscles , 
it can be shewn that still higher frequency components can be received. 
For the cat, a cyclic positioning of the liinb (i.e., complex but 
coordinated pav;, elbow and shoulder movements resembling stepping) 
has been shown to be the response to a cyclic variation in pulse 
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frequency nvcdulation from the vestibular nerve. Furthermore the 
dynamic response resembles a first order system with the corner 
freqviency matched to that of the lal'jyrinth so that the entire 
system becomes one in which a limb position correction corresponds 
to the vestibular (hence head) angular position (Partridge S Kim, 

1969). Hence it is postulated that the cue to the perception of 
motion lies in the awareness of postural tonus reflex to the total 
motion acceleration signal presented to the body. The evidence 
indicates that nedc proprioception affects the limb response to the 
vestibular’ stimulus such that the two signals (vestibular and neck 
proprioceptive) are multiplicative rather than additive (Kim S 
Partridge , 1969 ) . 

Vibration reception is not limited to the head-to-trunk 
relationship. Different elements of the body compose the total 
motion spectrum analyzer. Tlie analogy to the action of the cochlea 
of the inner ear as an harmonic analyzer may easily be drawn. The 
coupling between the trunk of the body and extremities other than 
the head also appears to bo a significant factor in the perception 
of motion cues. In the piloting situation most forces tending to 
produce accelerations of the body are applied to the trunk by 
transmission through the aircraft seat. There are, of course, 
forces transmitted to the limbs directly. These forces include the 
reaction forces of the controls, rudder pedals and stick, and those 
reactive forces transmitted to the muscles and joints of the limbs 
either through vibration or reaction of the limbs against a "stationary" 
surface v;ith respect to the trunk movement, fiij^ frequency, small 
amplitude vibrations transmitted through the limbs most likely are 
damped by the body articulation before reaching the head receptors 
or neck muscles and are transmitted to the CNS by the tactile and 
joint receptors. 

'fhere exists also vibratory motion in the range from 1 to 20 
Hz, a frequency band kncs-mi as the infrasonic range. No reports of 
the systematic investigation of the effects of this infrasound 
have been found althou^ it is evident that any auditory noise 
spectrum which contains components of these frequencies of 
sufficient pewer may possibly be transduced through the flight 
helmet to the head or through conductors in the aircraft body. 

The higher powered jet engines have noise spectra which show 
shifts of acoustic energy toward the laf;er ranges (belCT’j 100 Hz) 
and particularly below 20 Hz (Guild, 1965). There appears to be 
no rexxsrted research concerning the infrasonic spectrum within 
the cockpit environment. The highest bodily resonant frequency is 
norrunally 11 Hz; evidence exists suggesting that it is at this 
frequency/ that visual acuity is most greatly disturbed (Harris £ 
Shoenberger , 1965). 
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The fundamental vertical resonant frequency of the hijonan body 
in the sitting position appears to be around 5 Hz with a dampine 
ratio ranging from 0,575 (Vogt, Ctoermann .& Fust, 1968) to 0.167 
(Harris 6 Shoenberger, 1965). It is obvious that any acceleration 
spectrum which contains sufficient energy at this frequency will 
cause reception of a signal in the neck muscle tension proprioceptors. 

3,2,2 Contribution of ^^otion to Visual Perception 

The most extensively studied aspect of kinesthetic and vestibular 
proprioception has been its effect upon visual tracking. As Mayne 
(1965) has indicated, the "natural" body movements of the himan, 
covering the range of approxinately 0,04 to 4,0 Hz, are matched by 
the bandwidth of the vestibular system. The tracking capability 
of the eye (without motion conpensation) appears to be very accurate, 
within the linear range of eye movement (head stationary) , in response 
to visual input signals which contain no significant frequency 
oonponents above 1 Hz (Young, 1962), With the addition of vestibular 
and neck proprioceptor compensation the tracking capability of the 
eye is raised so that frequencies up to 2 . 5 Hz may be followed. 

Meiry (1966) studied extensively the role of each of the compensatory 
mechanisms of vestibular and neck proprioceptors v;ith respect to 
both environmental and earth-fixed fixaticxi points in the lateral 
(yaw) dimension. Enviroiimental fixation, i.e., a state in which 
the fixation point is stationary with respect to the observer, 
occurs when the pilot observes a cockpit instrument, the moving 
portion of which is not stationary with respect to inertial space. 
Earth fixed fixation, i.e., a state in vAiich the fixation point 
moves with respect to the observer but remains stationary with 
respect to inertial space, occurs when the pilot observes a 
stationary object on the earth (for a short enouf^ duration so that 
essentially the earth reference system may be considered stationary 
in space) or when a cockpit instrument dial moves so that it remains 
fixed in vertical space, e.g. , the attitude indicator except when 
yawing. According to Meiry 's experiments, the neck proprioception 
and vestibular systems have additive property effects upon the 
eye tracking cap^ility at least over the frequency range tested 
(0,03 Hz to 2.00 Hz), It will be recalled that Kim and Partridge 
(1969) have suggested that these effects may be multiplicative for the 
postural mechanism, although the latter (Kim 6 Partridge) report does 
not contain the same mathematical exploratiOTi as dees Meiry' s. It 
could be postulated that the moticn sensed inputs are combined 
differently for the two physiologic functions. 

Conpensatory eye movements caused by signals from the vestibular 
system and neck proprioceptors are reflexive in nature as are those 
signals provided for postural stabilization. In both situations 
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voluntary movements are initiated by overcoming the reflexive signal. 
Itoiry indicates that the disturbance to the eye tracking capability 
in the presence of motion (i.e. , environmental fixation) is within a 
maximum of only ± 0.5° in t};e frequency range from .03 Hz to 2 Hz. 
Apparently this i.s well within the range of foveal vision and not 
sufficient to disturb visual acuity. Hcvjevcr, it is evident from 
the eye traces presented bv Ileiry that a conmand signal from the 
motion receptors is received by the eye muscles driving the eye away 
from the fixated target w)iidi is later compensated by an eye movement 
to re-establish target fixation. 'Ibiis appears to te a rather regular 
phenon^non occurring at a fundamental frequency near 3 Hz. Meiry 
s\iggests that since the angular rotation of the eye prior to this 
return flid: (fast phase nystagmus) appears to be random, the 
phenomcjion is controlled by the central nervous system rather than 
position j.imiting in the eye. 

3.3 HCTTION SPECTHUTI OF THE AIRCRAFT ENVIROm^lIT 

The next aspect of motion cueijig v;hich sliould be oxairu.ned is the 
motion *' environment’^ in whidi the pilot finds hjjreelf when he dons 
his nev7 exoskeleton, the aircraft, in comparison to that which we 
have termed the natijral environment. In what vjays are these two 
environmental situations alike; hot; do they differ? 

Of what does the motion environment consist? In essence, it 
consists of a panorama of forces and torques and their time histories 
as tliey act upon the various notion receptive organs of the human. 

Tlic motion receptors have been discussed in Section 3,2. It is 
intuitively evident that sudi a panorama is immense and defies 
definition in the tin^ sense. It is less pleonastically described 
statistically, in terms of its spectral density. For any specified 
force, the pov/er spectrum describes the frequencies at which the 
largest concentration of po^/er or action producing mechanisms occur. 

One must te careful to select the proper spectrum in terms of 
receptor characteristics for examination,. For example, a receptor 
v/hich transduces relative position may have a higher response 
sensitivity to a comparatively lower fre<^uency component of a motion 
tlian a receptoi*' v;hich transduces acceleration. ^“Jhere the highest 
energy levels are concentrated the more accurately these signals 
must be received in order to replicate the transmitted signals. 

A seardi of the literature has failed to show any evidence of 
sudi a des orient ion of the acceleration environment in aircraft. 

Hixson and Niven (1068, 1069) have made numerous inflight recordings 
of the linear and angular accelerations at the pilot’s station in 
various military/ helicopters during the various ’maneuvers. The vehicles 
i_nclude the AIl-lG (Huey tobra) , Ulf-IB (Huey), 0H-6A (Cayuse), 01-54 
(Flying Crane), CH-47A (Chinook), and UH-2B (Seasprite). Ihe data 
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are illustrated as tine recordings and it .appears difficult to 
observe correlaticns in spectral signatures among the various 
aircraft ireneuvers and airspeeds. To date no spectral summary 
data of these recordings have been published. There are data 
supplied by aircraft manufacturers which can be used to describe 
the response in various dimensions of aircraft to atmospheric 
disturbances such as gusts, clear air turbulence (CAT), thunderstorms, 
drafts in cumulus clouds, etc. Considerable effort has been expended 
in deriving statistical descriptions of atmospheric disturbances 
(Press, Meadcu-re S Hadlock, 1956). A method for computing the 
spectral density of the response of the aircraft to this disturbance 
has been developed by Etkin (1959). Conputing the forces and 
torques at the pilot's station as a fmction of the velocities and 
accelerations of the center of gravity of the aircraft, one can 
describe statistically the motion environment of the pilot due to 
aircraft response to turbulent ai.r. From this one may derive the 
maximum^ angular and linear accelerations in any direction (i.e., 
pitdi, heave, etc.) and also the "character" of the acceleration 
(i.e., its frequency makeup). In essence this presumes the pilot 
to be only a passenger in the aircraft since this spectrum does not 
include the moveirent of the aircraft in response to the pilot's 
movement of the controls, which is, in part, a response to the 
disturbing function. 

The work done by HcRuer, Graham, Krendel and Reisener (1965), 
which examines human pilot d^amics with a large variety of 
combinations of controlled elements and forcing functions c<an be 
regarded as an investigation of the environment created by the pilot 
in order to ccmplete the given task (forcing function) with the given 
aircraft (controlled eleirent) . The authors have illustrated that the 
total environment tends to be constant. In their notation, Yp Yc 
is predictable and generally invariant in frequency ranges whicih 
govern closed loop system error. This work, however, does not 
include motion as an input to the pilot. Consequently we are left 
with merely a description of the visual environment with a fixed 
manipulator (i.e., one with invariant force/displacement dynamics) 
and fixed visual display, i'lagdaleno and McRuer (1966) illustrate 
the vari.aticn in environment produced by various manipulator load 
dynamics inposed upon the pilot. The variation produced by certain 
modes of motion in a ground based simulator was investigated by 
Stapleford, Peters and Alex (1969). This work apparently provides 
the closest description available to that of the in-flight, pilot 
induced motion environment. This motion environment represents only 
a facsimile of the one which we are seeking since the limited 
movement of the moving base of the simulator causes the motion to 
be adulterated. In essence, a description of the spectrum of the 
total pilot and gust induced in-flight motion environment was not 
evidenced by any research examined. Apparently many simulator 
manufacturers and customers use in their specifications data 
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concerning maximum e^qiected accelerations and velocities from 
examination of aircraft performance data and their experience with 
extant simalators. 

An heuristic descripl-ion of the aircraft motion spectrum includes 
contrasts and similarities vjith the "natural" environment. Since 
the aircraft was developed for control by the human operator (in 
contrast to a vehicle designed for fli^t without a human controller 
and/or passenger, such as a guided missile), one would expect that 
such a machine would contain characteristics which fit to a certain 
degree within the normal range of human experience. It should be 
kept in mind that this body machinery is higtily adapted by natural 
selection to the environment in whidi it has evolved and the short- 
coTnings of this machinery become apparent when we attempt to use it 
in a netJ environmental realm such as in flight. 

There a->^ many aspects of the flight situation which are so 
highly compatible in a motion perceptive sense witli the "natural" motion 
realm, that we may lead ourselves astray in analyzing motion cueing 
in simulator experiments by ura^jittingly designing experiments in 
which motion cues in fli^t are more or less in tune with those in 
natural motion. Turbulent hi^ speed - lew altitude fli^t is analogous 
to running, in respect to resultant forces on the pilot except for 
the periodicity of the running stride. However, this periodicity 
may be iniected voluntarily into the flight situation by the pilot 
as an active (i.e., energy producing) rather than as a strictly 
passive (following) component of the man-aircraft system. The only 
translation needed is the transformation of a reflexive limb muscle 
balancing response into an appropriate ccntrol response. Exaitdnation 
of the design of both control response direction and control feel 
indicates that these are consistent with the reflexive response of 
the limbs in postural control both in direction and appropriate muscle 
tension-relaxation relaticnships . A jet filter aircraft (i.e., one 
witli relatively rapid output response) being flown VFR in a pursuit 
course with rapid, relatively small deviations in roll and pitch 
represents the closest analogy in fli^t to that which we have 
termed the natural environment. The relationship, in a motion sense, 
to the running situation is easy to draw. As a consequence one 
would expect under these circumstances that the motion sensing 
apparatus of the human pilot can be utilized to its most full 
advantage. Even though the limb response must be relearned in order 
to manipulate the controller the reflexive response is fully 
operational. If, however, the entire motion sensing apparatus is 
to be used to its full advantage, all input information to which it 
c<an response should be supplied. Generally, the frequency content 
of the aircraft pitch response, for example, is upper band limited 
below tlie capability of the eye tracking compensation frequency 
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(2.5 Hz) and some phases of the direct motion sensory rsoeptive 
system. It is hypothesized that what the pilot v.’ould atteirpt to 
do is to actively supply these missing ipper frequencies. This 
type of input in part describes what has been termed the pilot- 
remnant. 

The remnant is that portion of the pilot's output which is not 
linearly correlated wi-th the forcing function. In other words, 
this portion of the pilot's response was not demanded by reaction 
to the system behavior directly. At frequencies in the range of 
1.0 Hz the pilot may be acting analogously to an adaptive control 
system which operates in a limit cycle. In such a system small 
high frequency pulses are used to disturb the system and. identify 
the system response to those pulses. The response to the disturbing 
signal is used to adjust the control system parametric gains. Weir 
(1966) suggests that such a "dither adaptive" scheme enables the 
pilot to readapt his describing function within a very few seconds 
to seme new controlled element function, perhaps produced due to a 
system failure. It becomes evident that system response in a 
simulator should be faithfully reproduced in the dither frequency 
range , if any accur&te response information is to be obtained 
ccnceming the con-trolled system. 

If the pilot is indeed dither adaptive, the question arises 
concerning -the source of the feedback information concerning the 
controlled element. In control systems in which ail feedback is 
visual, small perturbations in the visual scene give di-ther feed- 
back information. Systems in which both vision and motion feedback 
are present lend theirselves to adaptive feedback throu^ the 
motion receptors since Icwer total movement at hij^er frequencies 
are necessary to impart feedback signals to the operator. Systems 
in which cues to system state may be received through ccntrol 
movement feedback are pos-tulated to be most informative to dither 
adaptive behavior patterns. Control movement cueing is discussed 
in Chapter 4.0. 

In addition, to the movement which the pilot induces intentionally 
into the aircraft in order to produce the necessary high frequency 
inforr: tion, there are resultant movements of the aircraft due 
ei-ther to pilot inputs or to external disturbances which characteristically 
contain hi^ energy conponents of movement at frequencies less than 
the natural environmental spectrum. For example, a side force would 
call for a reflexive response of extension of a supporting limb in 
the direction of -the -^ide force. This is also the appropriate 
response called for in.-the aircraft ccn-trol design, i.e., to push 
-the rudder in the direction of the side force. Normally such a 
force would be of relatively short duration. Any prolonged stea<^ 
state force in -the aircraft environment must be interpreted ty -the 
pilot through the CNS by integration with the visual information 
to produce a correct interpretation of -the aircraft situation. This 
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is the technique p/resently in use in moving base simulators, i.e., 
using the gravity vector to simulate a side force by rolling the 
simulator to the appropriate side and depending upon the dominance 
of Cl St tong visual cue contradicting the angular proprioception of 
roll and enhancing the linear acceleriition proprioception due to 
gravity to produce the percept of side slip or skid. Whether or not 
such a technique is effective depends upon the dominance of the 
visual perception over the motion percept. This dominance is 
dependent upon several factors: the supposition that the pilot is 

watching exactly what he is supposed to watch when the movement is 
initiated, the experience level of the pilot, and the secondary 
demands or stress upon him. The less trained and more stressed, the 
more likely he will revert to reflexive behavior (Peters, 1969). 

There are many flight situations which ccntain frequencies 
lower than those of the natural motion spectrum. These movements 
in addition to those produced by purely visually derived phenomena 
such as autokinesis, are most likely the major contributors to 
spatial disorientation in flight. 

It is a reasonable hypothesis that these in-flight illusions 
are due to stimulation of the motion receptors in the unnatural 
(to man) three dimensional realm of flij^t. Peters (1969) has made 
a comprehensive examination of the relation of the vestibular 
system to (1) the illusory perception of motion, and (2) the visual 
illusions created by the effect of the motion receptors upon the 
oculomotor reflex system. The former group involve such phenomena 
as sensations of climbing in a turn, diving when recovering from 
a turn, opposite tilt in a skid, nose-hi^ attitude during take off, 
nose dewn attitude during deceleration, nose high attitude or 
inversion during pusliover from a climb to level flif^t, the leans, 
misestimate of degree of bank, graveyard spiral, graveyard spin 
and Coriolis illusion. The latter group include the oculogravic, 
elevator, oculogyral and Coriolis illusions. All of these phenomena 
are represented in in-flifh"t occurrences due to the fact that the 
motd.on receptors of man are not matched to the portion of the fli^t 
environment in which these phenomena occur. Tfiey are disorienting, 
in the sense that the pilot experiences a false perception of 
attitude or motion, but may or may not produce the phenonena commonly 
termed vertigo depending upon the amount of information available 
from other sensory sources. 

3.4 MCrriON PARAfCTERS IN MOVING BASE TRAINER DESIGN 

The design of moving base trainers and software designs of 
driving functions to these trainers have a tremendous range. These 
vary frexn the centrifuge, which simulates effects ranging from zero 
to hip^ "g" to small excursion, six degrees of freedom synergistic 
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platforms. Obviously a wide variety of motion characteristics might 
be incorporated into a trainer depending upon the intended use of 
the device. Some of those characteristics felt to be inportant for 
ccnsideration are discussed here. 

3.4.1 Uncorrelated Motion "Breakloose" Phenomenon 



Early in the development of moving base trainers, a motion 
phenomenon which can loosely be described as "breakloose" vibration 
was introduced. In such a device the movement of the simulator was 
coirpletely uncorrelated with movement of controls or visual display. 

The motion cues presented to the pilot by such a characteristic 
of the device may belong to the set of non-relevant , masking or 
conflicting cues depending upcn the structure of the spectral density 
of the bre^loose motion. Ihe breakloose vibration should be 
characterized as a random motion the mean of which is zero and the 
vSpectrum of whicJi consists exclusively of frequencies hi^ with 
respect to those generated by the pilot or gust induced aircraft motion 
environment. Several factors discussed in Sections 3.2 and 3.3 
should be considered in relation to breakloose vibration which is 
generally an attenpt to create the realism cue of engine induced 
vibration of the aircraft structure and/or lo/ intensity rough air. 
These include : 

1. The unkncwn spectrum of the pilot induced aircraft motion 
environuent . 

2. The resonant frequencies of the human body. 

The correlation of structurally transduced engine vil>rations and 
log.ical noises is discussed in Chapter 5.0. If it is found that the 
engine sound/ vibration phenomenon produces control or aircraft state 
cues, it is evident that the breakloose motion should be carefully 
structured so as not to produce erroneous information about the 
pcwer plant. 

The resonant frequencies of the human may be excited by the 
breakloose motion so that visual tracking may be disturbed. This 
resonance may also occur during buffet. An in-fli^t study of the 
effect of buffet frequencies (which are near 10 Hz) upon tracking 
precision in their fighter aircraft was made by Sisk (1970). In 
this study it v;as determined that the vibrational effect was primarily 
upon the pilot to aircraft displacement rather than upon the 
instrument to aircraft displacement. It has been mentioned in 
Section 3.2.1 that visual acuity is greatly disturbed at 11 Hz. 

There is the possibility that the instruments may be vibrated so 
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that reading them is difficult. Breakloose can interfere with 
the ability of tlie pilot to produce accurate input movements, to 
receive input information kinesthetically, and to apply dither 
adaptive procedures. 

Certainly if the frequency components of the breakloose vibration 
are lew enouf^ to cross into the pilot induced motion spectrum they 
may be interpreted as control cues throu^ reflexive body responses. 
The uncorrelated nature of the random vibration will produce 
conflicting cues a large percentage of the time. Whether the pilot 
is able to suppress reflexive responses either postiirally or in the 
oculomotor compensatory system is unknown, although preliminary 
analysis of results of an unpublished study using the Grumman Pesearch 
Simulator (1969) indicate that performance improves with suppression 
of uncorrelated motion at frequencies greater than 3,5 Hz. 

An additional and perhaps valuable attribute of breakloose 
vibratory motion is the capability for using it to mask erroneous 
cues produced by stiction in the simulator device mechanism or even 
to prevent such stiction. 

3.4.2 Uncorrelated Motion and Illusions. 



In Section 3.3 visual illusions created by motion receptors 
were discussed. These illusions can be evoked and have been studied 
in a centrifuge. According to Clark and Stewart (1967) judgments of 
attitude are influenced not only by stimulation of the vestibular 
system but are modulated by tactual and proprioceptive information. 
Coriolis illusions on the other hand appear to be independent of 
other sensory information. VJhen these illusions occur, their 
influence on aircraft control can be signicant. Cjertainly the 
training curriculum, whether in the simulator or in the aircraft, 
should include familiarization with the occurrence of these illusions , 
but it is not within the scope of this report to suggest investigative 
studies dealing with simulator training to increase d:?ility to cope 
with the effect of these illusicns upon performance. 

The motions involved in eliciting illusory phenomena arc 
ver^; low frequency as are those motions which are involved in 
producing motion sickness. Physical movement of the individual is, 
of course, not necessary to produce motion sickness. This can be 
induced by movement of the visual scene with or without concurrent 
movement of the observer. The investigation of motion sicJ<ness is 
also beyond the study recommendations to be made here, although 
studies vhich have been made by Barrett and Thornton (1968) and 
Barrett , niomton and Cabe (1970) indicate that the perceptual 
style (i.e. , field dependence vs. field independence) of the 
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individual is involved in the motion sickness phenomenon. Perceptual 
style may also very influential in the response of individuals 
to variatim in dynamic motion cues produced in simulators. Field 
dependency tests should be administered and correlated with motion 
variation experiments. 

3.4.3 The Hiysical vs. the Perceptual Fidelity Approach to 
terrelated ffotion in Desi^ . 

The trend in moving based simulation has swung from the early 
uncorrelated breakloose movement to a hi^^er degree of physical 
fidelity of simulator movement with actual movement of the aircraft. 

Physical fidelity implies the instantaneous correspondence in 
time of tlie linear and angular accelerations at the pilot's station 
in tlie moving base simulator with those linear and angular accelerations 
vAiich would occur at the pilot's statim in the actual aircraft v;hich 
is being simulated. An attempt to produce pihysical fidelity has led 
to the conclusion that total ground based physical fidelity is 
inpossible and some "point of diminishing returns" should be reached 
at which no additional benefits in motion cueing can be reaped by 
larger simulator excursions. 

The "point of diminishing returns" approach also appears to be 
futile. 'Ihis approach still looks toward the concept of physical 
fidelity rather than perceptual fidelity, which is the conceptual 
orientation of this report. 

The dominance of unambiguous motion cueing in the hi^er 
frequency ranges of the spectrum would indicate that accurate 
duplication of movement of these frequencies would contribute the 
greatest information to the control strateg/ which must be learned 
in order to produce the greater transfer of training between the 
simulator and aircraft. Analysis of the postural cueing nechanism 
suggests the area in vjhich perceptual fidelity should be equated to 
physical fidelity is in the frequency range in which postural cueing 
is significant and in the dimensions in which tine postural cue is 
the strongest. Interestingly if one considers the discussion of the 
head rocking and neck tension in Section 3.2.1, the dimensions of 
aircraft motion which produce the largest postural cues are heave, 
pitch and roll! In order to produce these accelerations accurately 
in a ground based simulator even in the relatively hifh frequency 
ranges at least a small amount of lateral and fore-aft travel must 
te induced to compensate for the effect of gravity. It is also 
possible that slight displacements of the body without total motion 
of the simulator cab can produce the same cue phenomenon. A device 
such as the Dyna Seat should be examinexl as a possible adjunct to the 
total cal) motion. Hiis may also be a device which may prove useful 
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in overcoming, the erroneous cue produced by the necessity of 
"washin^T out” a cab displacement at frequencies which pr^uce motion 
primary cueing or when visual cue dominance is not significantly 
strong to relegate motion cueing to seccndary cue status, 

3.5 SIMULATOR HCmON AS AN EXPERIMENTAL VARIABLE 

VJhen carrying out research on the effects of simulator motion 
it is necessary to be operationally specific about what is meant by 
the motion characteristics of a simulator platform or other motion 
cueing device and by V7hat netric or measurement they are expressed 
and quantified. Once motion characteristics are specified in 
operational terms as they apply to the dynamic movement of a crew 
station, enpirical relationships can be established %tween their 
variations and other parameters in the training situation. The 
operational definition of the characteristics of motion and their 
method of measurerrent are necessary prerequisites to research on 
basic cues and transfer of training. 

The analysis of motion cues has been approached with the goal 
of postulating what cues the pilot has available to him in exercising 
control of his aircraft. Once these cues have been postulated, the 
question becomes one of creating those cues for him by whatever 
Tteans are possible within the constraints of a ground based motion 
device. The requirements for motion are then dictated by the 
requireriEnt to provide the stimuli which produce certain cues to 
the pilot rather than duplicate the motion characteristics of the 
aircraft per se. 

Boundaries must be set about t]:ie population of motion characteristics 
to te examined. In this study consideration is limited to those 
characteristics ivhich provide cues to operators of aircraft. Fijrther, 
they are limited to those characteristics of military aircraft, 
both rotary and fixed wing, which the Navy uses for training and 
operations. Thus, in setting bounds upon the research to be carried 
out on simulator motion, only those aircraft in the Navy inventory 
and those categories of control outlined in Chapter 1.0 are considered. 

In summary, descriptoirs of motion characteristics and methods 
of measurement are needed which will allow manipulation of motion as 
an independent variable in determining the effect of its variation 
upon pilot beliavior. Further descriptions are needed which are 
useable by the simulator desipp engineer. To accomplish this the 
specification of the measures and procedures by which v;e determine 
the motion characteristics of a motion cueing device need to be made 
explicit. 



(. • 

ERIC 



41 



4 






NAVTRADEVCEN-69-C-0 304-1 



3.5.1 Measurement of Motion Device Characteristics 



When the goal is to determine the characteristics of any physical 
system, it is necessary to be e)<plicit concerning the metrics used to 
describe the system and the procedures by which the values of these 
metrics are to be determined. A simulator platform is such' a physical 
system. The discussion here refers to motion platforms and simulator 
motion devices (e.g. , Cyna Seat) althougii for convenience, the term 
motion platform is used to denote all such devices. There are two 
distinct aspects to the description of the dynamic response 
characteristics of the simulator platform. The first involves a 
description of limits of linearity of the device ; these are usually 
described in terms of maximum displacements, velocities and 
accelerations and commonly described in a system vibration nomograph. 
(See Figure 3,2). The second aspect is the response characteristics 
within these limits whidi can be approximately described by a linear 
differential equation. The solution of this differential equation 
consists of two parts : 

1. The complementary function, which describes the transient 
portion of the response , and 

2 . The particular integral , whidi represents the steady state 
response . 

A man, whose sensory receptors are being stimulated by the 
movement of the motion platform, perceives not only the steady state 
but the transient portion of that movement. Hence some metric which 
describes both transient and steady responses to a given input must 
be used. It should be noted the term steady state may or may not 
be a static state. It is equally valid to speak of the steady 
sinusoidal response as the steady state step or pulse response. 
Similarly one may refer to the transient response of a system to 
any of these three (or any other) inputs. 

Performance criteria of physical systems have (until relatively 
recently wit)i the development of optical control theory) been 
expressed in terms of time constant, rise time, settling time, 
maximum overshoot, etc. in response to pulse or step inputs. These 
criteria are the easiest ones to "visualize," and to m^e assumptions 
about concerning their relative merits. For example, one may 
hypothesize that too long a time delay (i.e., time constant) between 
an input and the appearance of an output will be of negative benefit 
to a human operator of a system. Intuitively this appears to be a 
reasonable assuirption. Again one may make judgments concerning 
the relative merits of the magnitude of the overshoot of a system 
response and magnitude of rise tine of the same, system. Unless it 
is possible to analyze a system in terms of optimization of specific 
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mntiningful inission oriented criteria, these above mentioned 
performance qualities are fundamentally educated guesses. 

It can be shovji that the time response of a linear system to 
<'any kncwn driving function uniauely determines its frequency 
response and conversely, if the frequency response of a system is 
kncwn its time response to any specified driving function is uniquely 
determined. 

Using this unique relationship betweers the time domain and 
frequency domain it becomes a matter of selecting the domain which 
offers the greatest ease of computation and manipulation. Generally 
speaking systematic analysis and synthesis procedures are more 
numerous in the frequency domain. Consequently, the frequency 
domain lends itself for selection as a metric for description of 
the motion platform characteristics. 

When speaking of the variation of these characteristics in the 
frequency domain, it should be kept in mind that the ultimate concern 
is V7ith the effects of these changes in the time domain. Since 
there is no a priori knowledge of the pilot's input, it is impossible 
to descritje analytically the driving function to the motion platform 
so the specification of the response of the platform to any specific 
input will necessarily be rather arbitrary. When one describes the 
system characteristics in the frequency domain, he is in essence, 
placing a blanket specification on the system response to any. driving 
function. When one alters system characteristics in the frequency 
domain, he varies sudi phenomena in the time domain as rate of onset 
of platform acceleration, platform acceleration, platform rate and 
platform position at any instance of time in conparison to the driving 
signal. It is possible then, to vary systematically the system 
characteristics and to determine the relation of this variation to 
pilot control behavior. 

3.6 E>rERIHENTAL TESTING OF THE HYPOTHESES COJCERl'lING MOTION CUEING 
3.6.1 Development of a Physical Model . 

The discussion in Sections 3.2 and 3.3 concerned the postulating 
of certain principles (based upon physiologic and behavioral data 
from the literature) which constitute the elements and elemental inter- 
actions of a model of the htjinan operators response to vehicle motions. 
It remains to develop the hypothetical mathematical relationships 
whidi govern the head-neck articulation and the resultant signals 
therefrom, based upon the postulates developed in the discussion in 
this Qiapter. Processing of these signals to evoke reflexive postural 
response occurs most probably in the peripheral nervous system, as 
indicated in Figure 3-3,- and additionally in the Q'JS. The modeling 
of the processes within the centers of the nervous systems shown in 
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Fij^ure 3-3 remins to be accorrplished. The development of this 
aspect of the model should add a great deal to our understanding of 
t}ie sufficient as well as the necessary simulation of mcftion. Until 
such a model is developed, we must rely upcn 'that portion of the 
total model about which some valid appearing conjectures can be made*. 
Even a limited model will give insist into the critical experiments 
to be conducted in order to validate, modify, or extend the model. 

The derivation of the equations which express the inertia, 
viscosity and springiness of the articulated portions of the body, 
which act as motion sensors, becomes the fundamental task. Recalling 
the discussion in Section 3,2, in wliich the various portions of the 
body were described as being analogous to sections of a harmonic 
analyzer, it should be kept in mind that the signature of the signal 
(i.e., engine vibration, aircraft response to control movement, etc.) 
to be conveyed to the operator should dictate the area of the body 
with which the mathematical analysis should be concerned. For example, 
it may be necessary to transmit engine "buzz" only to the limbs 
rather than to atteirpt to move an entire simulator platform. Once 
the equations of motion are derived, the numerical values of the 
parameters which comprise them must be determined. Although mass 
and inertia remain constant, voluntary control of muscle tension 
causes considerable variation in both elasticity and viscosity 
(Agarwahl, et al. , 1969). The range of elasticity particularly will 
vary the bandi^/idth of sensitivity since frequency is directly 
proportional to stiffness. This model then will give the approximate 
frequency bandwidth to which various portions of the motion sensory 
system are sensitive, 

,3.6.2 Measurement of t)ie Aircraft Acceleration Environment 



More information concerning the in-fli^t acceleration environment 
must be obtained in order to corplete the sensor - input block in 
tlie motion perception picture. A partial description of motion 
information can be gleaned from data which describe the three linear 
and three angular acceleraticns at some point near the pilot’s 
station. These in-fli^t data may be used with the receptor'- interacticn 
model described in Section 3.6.1 to develop an hypothetical inpurt to 
the nervous system. A more desirable set of data would include 
measures of the forces acting upon the various component parts of 
the motion sensory system. For example, observations of automobile 
drivers can be made in which the operator will align his head so that 
the eye line rerrains parallel to the horizon even if t)ie vehicle 
does not. In this case a set of accelerations measured along axes 
fixed to the vehicle is not indicative of the signals received by the 
vestibular system. 
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Command Signalt 

Signals 



rifTure 3-3. n.orj diay^am sha/;inp; neuro-musculan- vestibular pathways. 

(Adopted fron McPuer, D. T., Hofmann, L, G, , Jex, H. R. , 
lioore, G. P. , Phatak, A. V., Vteir, D. H, , Wolkovitch , J. 
Hev; Approaches to Human- Pilot /Vehicle Dynamic Analysis, 
Tedi. kpt. AFFDIj-TR- 6 7-150. Air Force Fliplit Eynamics 
Lalxsratory, Air Force Systems Command, Wripht-Patterson 
A±r Force Base, Ohio, February 1068. AD 667 549) 
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The form in which these data are sumnarized is also of iirportance . 
It is recommended that the spectra density of forces as a function 
of frequency be the basis for the presentation of the in-fli^t data. 
Coirposite data by aircraft type and maneuver should be examined to 
determine the actual range of physical variation of motioi information. 

In addition, it v/ould be useful to ccnpare these data with an 
accurate determination of the spectral density of the natural movements 
of man. If these data include variations such as movement with and 
without the visual sense and movenent of labyrinthine defective versus 
normal persons, an estimate of the contribution of visual and 
vestibular inputs can be made. 

3,6,3 Testing the Model on Simulation Devices . 

Assuming that the model described in Section 3.6.1 and the natural 
motion spectrum have been described as a function of frequency, it is 
possible to designate tlie bcmdwidth of the postural reflex system. 

It has been hypothesized in Section 3.2 that the unambiguous assessment 
of the motion environment is possible only when the postural reflex 
is invoked. It may be inferred from this that perceptual motion 
fidelity in this range requires physical motion fidelity. If this 
is so the effective bandwidth of the simulator may be adjusted initially 
to conform to the postural reflex bandwidth. The effective band- 
vji.dth of the simulator platform is a function of the electro-mechanical 
hardware as well as the computer software from which driving signals 
to the platform equipment are derived, as discussed in Section 3.5.1. 
Variation of the lower frequency cut-off of the motion spectrum in 
roll and lateral tr^slation was the point of investigation by 
Stapleford et al. (1969). The upper cut off frequency remained 
constant in this study. In view of the hypotheses of this Chapter 
the upper frequency cut-off of the simulator used in Stapleforxl's 
stucfy appears to be too lew to allow postural reflex fidelity. With 
a gyro-horizon as the visual display Stapleford was able to increase 
the lower cut-off frequency to as hi^ as 2.0 rad/sec without 
significant variation in performance. The effect of increased visual 
gain may be to increase the lower cut-off frequency beyond that 
possible with instrument displays. The interaction of the effect 
of the hi^ frequency cut off and the bandwidth of the controller 
may also be the subject of simulator investigation using a similar 
experimental technique. 

The development of a device similar to I^a Seat which torques 
the trunk or other parts of the body in order to produce the desired 
response would be a valuable asset in testing further hypotheses. 

Such a device' may be used to produce unbalancing forces on the body. 

The angular motion of the entire simulator platform may be combined 
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v;ith this device to test the postulate as set forth by Roberts 
(Section 3.2) that the semicircular canals add the equivalent of 
quickening to the closed loop system. 

Ihless the time sequencing of the interaction of control movement, 
muscle stretch, vestibular and visual cueing is established, it is 
not possible to assess the contribution which the vestibulorocular 
movement makes to the perception of motion. Investigation should be 
made into the question of whether movement of the eye induced by the 
labyrinth signals is principa].ly a long term (i.e,, IcS'/ frequency) 
phenomenon. If so the relative motion produced by moving the pilot 
only and not the entire cockpit contributes only a minor error to 
the eye tracking capability and does not ccmplicate the motion perception 
phenomenon. 
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4.0 CONTROL ^DVEMEINT CUES 



A feature of ground based trainers which has only recently been 
given any degree of attention is that pf the cues derived by the 
operator from the movenients of his limbs as he actuates controls. 

'fhese are the kinesthetic cues which are the siibject of discussion 
in this Chapter. The inportance to training of the degree to ^^hich 
these cues are reproduced in the trainer is virtually \.inknown. 

Little research bears on the problem of the use of these cues in 
vehicle control and has been directed toward the effect upon 
transfer of training. Also, there is no uniform dimsnsion(s) along 
which the parameter of control "feel" can be measured. Matheny and 
Wilkerson (1965) in a revi«-j of the problem of control feel 
distinguished two types of feedback from the stick, i.e. , pressure 
and displacement. Hoi^jever, the relationships between gradients in 
pressure or displacement and system output are not known in anything 
approacldng a ccmplete way. Data provided by Jenkins (1947) 
demonstrates a Weber function for discrimination of changes in 
pressure which is one small step along the way toward the acquisition 
of the needed information. 

Recent studies by Herzog (1969) give evidence of the inportance 
of the limb position cues to the operator in compensatory tracking 
control. Herzog's results shew that the combination of force and 
position (displacement) cues resulted in better performance than 
force cues alone for the types of control systems investigated. 

He further found that variations in manipulation spring constant and 
in viscous friction had negligible effect upon tracking perf orirance . 

The importance of some information feedback to the operator 
that he has definitely made a control input into the system is 
important in tliat it allows hiiTi to differentiate among the cues 
he is receiving. For example, as; the pilot flies his aircraft in 
moderately rough air, feedback from his control inputs allcws him to 
differentiate those movements of the aircraft which are due to his 
control inputs and those due to turbulence. Thus, he is aided in 
the control of his aircraft. SinuMarly, when using visual displays 
for compensatory vcaining, the knowledge of his control inputs 
allcws the pilot to differentiate those responses of the system due 
to his control input and those due to external forcing functions. 

It is also important that we recognize that significant inter- 
actions may obtain among parameters of the control. For example, 
Huckler and liatheny (1954) found no differences in time to reach 
criterion proficiency on a transfer task when control couloimb friction 
was varied as an experimental variable in the training task. Nor 
did they find differences when control direction was reversed. However, 
when the interaction of these was studied a quite marked decrease 
in performance was observed. 
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The work of I^theny and Wilbanks under the Army /Navy Instrumentation 
Program (ANIP) in 1959 is directly relevant to the problem of control. 
Research under this program was divided into the two areas of (1) 
function integration, and (2) information feedback. Under function 
integration the ccncem was with the analysis of the functions to 
be controlled, thej'^ disposition and assignment. With respect to 
training devices it goes without saying that functions as assigned 
and integrated in the actual aircraft would be replicated in the 
training device. Infonretion feedback was defined as the kinesthetic 
feedback of information derived for having moved the control by limb. 

I\'70 prime considerations were felt to be important: (1) infonretd.on 

coming frcm two or more sense modalities must not provide conflicting 
infonration and (2) v;here possible, information from one sense modality 
may be used to supplement information received by another. Thus, 
the informtion received by the operator as a function of the extent 
of ciisplacement or" amount of pressure introduced into a control could 
serve as a source of information to him for determining the present 
or predicted state of the vehicle. 

Experiments carried out under the ANIP program having to do with 
feedback from controls are inportant to training dn one respect. In 
these experiments both pressure and displacement controls were 
used with the same experimental equipment in which variation in lags 
in control display ratios as well as two different system transfer 
functions could be introduced. The system transfer functions were 
(1) a positively accelerated function and (2) a negatively accelerated 
function. The positively accelerated function acted as an unstable 
system with the negatively accelerated function acting as a stable 
system. One of the interesting results of the experiment was that 
the displacement cont:. ol appeared to be superior to the pressure 
control for systems with lags above 0.3 seconds v/hen the control- 
display ratio v;as constant. This finding held for both the stable 
and the unstable systems. The projection of these results to the 
requirements for trainers means that it may be iirportant that 
pressure feedback not be inadvertently introduced into the control 
system of the trainer when the prime feedback source in the air- 
craft is displacement. Ihe Matheny and Wilbanks data would indicate 
that the cut-off frequency of the system may be important in this 
respect. 

The first order of business in the stucty of the kinesthetic 
feedl)ack fron ccntrol manipulanda is the development of a construct 
by which the characteristics of the device may be measured and 
systematically varied as an independent experunental variable. The 
construct which we recommend to be intensively investigated is that 
of the Effective Time Constant of the control. The basic concept 
of this constant is identical to that discussed in Section 1.4. 

Ihe concept has been discussed fully by Matheny and VJilkerson (1965), 
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by Kathcny (1967), and Matheny (1969) and is based on the simple 
notion that effectiveness of operator control in a closed loop system 
is a function of the rapidity with whidi the operator receives feed- 
back of the result of his control movement. Tiie effective time 
constant for the visual sense my be determined for each dimension 
of control from kncwledjF^e of certain machine characteristics and the 
operator’s threshold for perception of the machine output. A similar 
analysis can be made of the control manipulanda. Such an analysis 
is in need of development in the study of the cues presented to the 
operator >:>y the control being manipulated and in the study of the 
interactive effect v;ith other sensory cues. 
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5.0 A10ITORY CUES 



5.1 im'RODUcnc^ 

The previous sections of this report have used the information 
array approach as an analytic basis for the postulation of ^es used 
in aircraft control and recx^inmendations for needed research. This 
Chapter vjill deal with auditory cues and use as an analytic basis 
the stinulus-environjnent approach, as described in Chapter 1. The 
reasons for choosin^^hrs approach will be developed in this Chapter 
and are centered in our impression that the inforrration available for 
the postulation of auditory cues in aircraft control is suR^z;estive 
but incomplete. Therefore, even though it may be possible to 
postulate auditory cues v/ith an information array approach, certain 
informaticn is lacking which must be obtained using the stimulus- 
environment approad'i. In addition, special considerations in the 
identification and quantification of aural cues are discussed along 
with recomended alternatives w?iich lead to the postulation of aural 
cues for aircraft control and their presentation in a simulator. 

5.2 S0Ui\T) USEID AS INTOmTION FOR COOTROL 

Ihere is anecdotal evidence that pilots use sounds as cues for 
control. Tile literature lends support to the notion that this is 
the case. 

First, there are many exanples of the use of auditory- type 
display infonration for the control of the aircraft. The outmoded 
aural radio range was once a primary means of radio navigation. 

Pilots were presented a Morse A or N when deviaticns to the rigjit 
or left of a desired trade occurred, Matheny and Wilkerson (1966) 
cite deFlorez’s v;ork in v^^hich he demonstrated that a pilot could 
fly an ad.rplane with his eyes blindfolded when certain aircraft 
movements were encoded aurally. Other work cited by Matheny and 
V^filkerson (e.g. , Forbes, 1946) verifies this. But, with the 
development of sophisticated navigation and display equipment, 
auditory signals were relegated to a secondary nlace as the 
navigational information was presented on a visual display. Vision 
thus became the nrimary sensory modality for control along and 
about the axes of the aircraft both dioring IFR and VFR flight. 

Second, there is evidence that pilots can and do utilize the 
noise levels of reciprocating engine helicopters as a primary cue 
in the control of the engine rpm. This noise probably emanates 
from the engine, the exhaust, or a combination thereof. In single 
engine monoplanes noise levels have proven useful in the same 
manner. Engine rpm and propeller rpm can be cantirolled by making 
use of sounds. Other sounds such as the characteristic ’’whistle" 
or "sieh" liave been used by pilots as a cue to an approaching stall. 
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Third, there is good indication that the auditorj^ modality is 
quite useful as a warning signal detector and that peculiar noises 
cire used for this purpose in the aircraft. Henneman (1954) reported 
that auditory stimuli tended to be inherently more attention demanding 
than visual stimuli of moderate intensity and that the ear was 
s\iperior to vision for communicating warnings, commands, and 
status information to the operator. 

It seen^d reasonable, therefore, to postulate that there are 
aural cues whidi may be used in the control of an aircraft. However, 
we felt it desirable to diwStinguish inherent frcm man-made sounds. 

ITvit is, the primary interest of this report was in whether the sounds 
are an integral part of the aircraft and as such could be correlated 
with aircraft control input, or whether the sounds are a part of a 
pre-programmed warning device presented over the intercomrnunications 
system of the aircraft. One would obviously concede that the latter 
would be an excellent auditory cue for control of the aircraft whereas 
the former requires more explanation. 

5.3 CUES IN Tin: COCKPIT 

5.3.1 'Hie Cue Taxonoiir/ 



It was assumed that it is possible to identify relevant, primary 
auditory cues and that pilots can detect and use these cues for 
control. Such primary cues could be used as a means of providing 
information for the control of the aircraft or as a primary warning 
device. It was also assumed that auditory information could serve 
as relevant, ccrrplejDentary cues, enhancing and verifying information 
from other modalities and serving to add realism (in a simulator). 
Further, it v;as assumed that sounds cam serve to mask relevant primary 
or secondary cues or conflict with complementary cues. 

5.3.2 The Referent and Control Index 



In Sections 1.3 of Qiapter 1 two concepts were outlined: 
the referent and the control index. In considering aural cues for 
control the standard or referent may be considered to be stored 
internally, (i.e., in memory) xvhile the control index would be the 
perceived sound v/hich is to be corrpared with the referent. For 
example, the pilot would be presented with a particular sound and 
would corrpare this sound with his memory of the pitch or loudness 
level of the sound, adjusting the sound he perceives (the control 
index) with his stored referent. 
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5,3,3 Correlated vs, Lhcorrelated Sounds 

It is important in delineating cues in aircr^t control that 
these cues be correlated with control input or state. Primarily, 
the specification of a sound as a cue inplies that this cue is 
IxDth detectable and useable by the pilot. A sound that cannot be 
correlated with a control input or state of the aircraft is, for 
all intents and purposes, useless to the pilot as an aid in control. 
Implicit in identification of a sound as correlated and useable as 
a cue to control is the idea that there are uncorrelated sounds also. 
Such a dichotony seems to add confusion to the issue if the problem 
is approached along the lines that a somd which is not correlated 
witli control input or state is uncorrelated and is merely back- 
ground noise. Such may be the case, but in one sense background 
noise informs the pilot as to the. state of the aircraft and, 
according to our operational definition this vjould be a correlated 
sound. The situation may be resolved by stating that, unless the 
pilot can and does associate the sound with a control input, state, 
or change of state of the aircraft it is for purposes of identification 
classified as uncorrelated. It may be convenient to think of 
uncorrelatcd sounds as serving nainly as background unless the 
sounds can be associated with some aspect of control, at vjhich 
time they tecone correlated sounds. The important point is that 
any sound which can be correlated v;ith some aspect of status or 
control can become a cue .for control. 

5.3.M S ound Sources 

Tlic literature is sparse regarding in.formatinn as to aural cues 
for control of aircraft. Perhaps the most complete exposition 
regarding sounds in aircraft environments is contained in the works 
of Hatfield and GaseC^ay (1963), Gasa^-zay and Hatfield (1963), and 
CasavN/ay (1969). These authors have documented internal and 
external noise environments for each major type of Army aircraft 
during normal, operations including ground oper^ations, hover, normal 
and maximum cruise conditions, 'Ihey discuss in detail the major 
contributions of noise generators in these environments and graphically 
present tlie data by octave-band analysis of intensities. 

The v/orks by Hatfield and Gasaway and Gasaway and Hatfield v/ere 
done primarily as a contribution to aviation medicine, documenting 
the noise leve^ls in aircraft in order that medical personnel would 
l:>e avjare of damage risks involved in flying. For xlnis reason much 
of the data are less than optijnal for the purpose of postulating cues. 
As an example, recordings are not made at the same location for 
all modes of flight, power setting, etc. for all aircraft. 

Consequently .it is imposs.ible to generalize with precision and, 
specifically, to derive the functional t>elationships that exist 
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between control input and intensities at certain frequencies, 
i Nevertheless 5 much useful information is conta5jied in these 
volumes that is directly relevant and helpful. 

Using the MI-1 series helicopter as an example, one sees that 
the different intensities inside the cockpit, when measured at 
the same location at different newer settings, are a function of the 
flight profile. One sees a shift in the curves such that during 
ground operations the 37. ^-75 Hz octave-band contains the most 
inLense levels and duri.ng normal cruise the more intense noises 
are in tlio 75-130 Hz band. Such trends are, for the nxost part, 
coirirnon to all the aircraft sanpled. 

Perusal of the document by Gasaway and Hatfield shews that the 
preponderance o.'^ higher intensities are in those octave-bands below 
1700 Hz. There are several implications which may be drawn for this, 
not the least of which is that loudness level may serve as an aural 
cue to control. Since the lower (below 1200 Hz) octave-bands contain 
the higlier intensity levels this would mean that pilots could use 
loudness as a cue regardless of age. This is predicated on the 
work of }-'obinson and Hadson (1956) wtio found that equal- loudness 
relations vjitli pure tones v/as independent of age at and below frequencies 
of 1 Idlz. Further, LicJ<lider (1951) cites evidence that at higher 
dl; levels and lower freauencios, smaller incremental changes in db 
rire necessary/ to detect changes in intensity. 

In the Gasc5v/ay and Hatfield studies there is evidence of frequency 
sJiifts as fliglit modes change. From this evidence we may also 
postulate that frequency/ is important and may serve as a cue in 
control. Again Lid'lider (195]) cites evidence to indicate that at 
intensities above 30 db and at frequencies below 1 >dlz, changes of 
3 Hz can be detected. 

Because of tlie nature of tlie data cited, tlie generalizations that 
can l)e mde are less than precise. Even though it appears at this 
point that pitch and loudness (the experiential si.des of frequency 
and intensity) can be related to control as cLies, additional recordings 
arc called for so that they may be examined further. It is the 
necessity for these additional data which dictate the use of the 
stimulus-environment approacli as the. analytic basis in this portion of 
the investigation. Further, nothing has been sai.d about the complexity 
of the v/aveform whicli the pilot is expected to analyze in extracting 
the cues. The stimulus-environment approach vjill aid in this respect 
and would, in addition, alla^j for verification of postulates as well 
as give needed information concemirig frequency, intensity, waveform 
and spectral density/. Collecting these data is viewed as an important 
step for several reasons. 
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If loudness is a cue for control the gaps must be filled 
because loudness is a function of the frequency, the intensity, 
and the bandwidth. Consequently verification of our postulates 
is contingent upon these three. 

Bandwidth is important in its cwn right. For exanple, three 
bandwidths may have the same area in tenns of sound intensity 
density spectra but may not be equally loud. These must be 
determined and correlated with control input or state of the 
aircraft in order to meet our criteria as a potential cue. 

Too, the width of the critical bands must be specifiable since 
this is a central part in the concept of masking. 

Equally, pitch is more closely related to frequency but the 
relationship is not precisely linear. In order that we may be 
most specific, the relationships between the environmental variables 
of frequency, bandwidth, and intensity must be kncwn and specifiable 
insofar as they affect the pilot. 

Ihe postulation of aural cues in ccntrol in terms of pitch and 
loudness raises the question of the operations of tlie ear in handling 
these inputs. It is beyond the scope of this report to deal with 
the problem in detail, but the point must be made that considerations 
as to whether the ear is primarily a frequency analyzer or can better 
be understood as an autocorrelator (Licklider, 1951) must be taken 
into account in the analysis of sounds for identification of possible 
cues. 



It is evident from Gasaway's work that certain portions of a 
helicopter have characteristic frequencies which add to the total 
noise spectrum of the aircraft. It is not difficult to visualize 
tlie pilot as being able to determine conponents on the basis of 
pitch. It may be that the pilot is able to use both loudness and 
pitch at the lower frequencies, particularly at higher intensity 
levels, as cues in control, v;hile he may use changes in frequency 
at the higher frequency levels. It is such postulates as tliese 
which may be generated through analysis of the sound data. 

5.3.5 Masking 



As indicated above, the bandwidth is critical as a factor in 
masking. The closer the two bandwidths are the more one will mask 
the other. 

As v;as evident in searching the literature, much of the infor- 
mation in audition is in terms of pure tone research. Nonetheless, 
with pure tones, low frequency tones are more effective in masking 
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high frequency tones whereas with the Jnasking of pure tones with 
v;hite noise it was found that inasking was less critically a 
function of the frequency of the masked tone than with the pure 
tones (Licklider, 1951) • 

TJie relationship seems to be much less coirplicated insofar as 
intensity is concerned. We find, for example, that, no matter vjhat 
the frequency of the j/iasked tone, masking increases as the noise 
becomes more intense (Licklider, 1951). 

Thu5J, both the frequency and the inteirsity of sounds appear to 
mas]', other sounds by raising the threshold or in some other way 
iTviking it impossible to separate the tonal stimulation into compcxients 
and tlience discriminate the presence or absence of a tone. This is 
critically related to our postulations regarding the cues of pitch 
and loudness, particularly at the lower frequencies and higher 
intensities encountered in the cockpit environment of aircraft, 

Ihus, sounds vjould mask cues in the same modality, as described 
above. The masking of cues in other modalities vjould probably take 
the form of conflictirig with incoming information by drawing attention 
from that information to some sound component. 

5.3.6 Contingencies 

Ihere are several factors vjhich bear directly on the problem of 
whether a pilot can detect and discriminate pitch and loudhess 
levels of sounds in the cockpit environment; namely the auditory 
apparatus, the nature of the equipment, and the type aircraft. 

The ability of iiie pilot to make detections and discriminations 
is certainly dependent upon the state of his auditory apparatus. 
Surveys have shown that helicopter pilots are losing these abilities 
in the upper frequencies at an alarming rate. In dealing with this 
problem, Camp (1966, 1967, 1969) has done a considerable amount of 
work in recording noise environments of Army aircraft in order to 
improve attenuation diaracteristics of helmets and improve speech 
intelligibility. Thus, an improved helmet, in terms of attenuation 
characteristics, will probably reduce for a time the detectability 
of loudness levels by the pilot. However, it may be that signal 
detection will improve (Hatfield and Gasaway, 1953), and that the 
pilot can adapt to the attenuation characteristics and still be 
able to detect important cues. 

Finally, as Gasasr/ay and Hatfield (1963) pointed out, different 
aircraft will have different noise environments, making the detection 
and discrirninaticTi contingent upon the type aircraft. 
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5Jl RECOMMIJJnATIONS 

In secticn 5,1 it was indicated that the stimulus-envd.roninent 
apprcadi was deemed the more feasible approach to the investigation 
of aural cues in control* It should be evident at this point why 
it was felt that such was the case. To clarify the issue further 
one might look at the logical sequence in any research in v^ich the 
investigator expects to make postulations and implement them. The 
normal sequence in such a case would be to nelie postulations based 
cn empirical evidence (and perhaps calculated guesstimates) and 
take these postulates to the particular laboratory or field setting 
and set about to test them in an acceptable empirical way. This 
Chapter, on the other hand, has postulated certain cues and cue 
sources based on less than optimal information* In fact the data 
themselves recommend a more conplete analysis of internal environments 
of the aircraft of interest in order to accept or reject or modify 
the postulates which have been made. Thus, the data are incomplete 
and would not allow for verification of the postulates* It is, 
therefore, essential to the verification process that the internal 
sound environnv^t of the aircraft of interest to this study be 
recorded and analyzed using recordings ax the pilot’s station so 
that functional relationships between data and control input or 
aircraft state can he derived. This bears directly cn the concepts 
that have been postulated witii regard to predominance of certain 
frequency levels and the relationships of loudness level to frequency 
level, as outlined in this Chapter* 

Analysis is particulcirly important for the synthesis of the 
sound in the simulator. For example, we have indicated that certain 
relationships exist in masking. In the event masking was deemed 
desirable in a simulator it would be important to knew vjhether a 
hif^ frequency or Icx^; frequency sound was to be masked. It may 
not be enouj^ to merely introduce white noise in the simulator* 

These are soire of the problems which require alleviation before 
sound syntliesis is accomplished. 

To this point synthesis and design of soiind simulation have 
been based on subjective evaluation of electronicaTly-produced 
sounds which iray or may not represent the actual sound field. 

Table 1 represents the Research Tool Digital Conputer System (RTDCS) 
concept of sems of the sound effects and the required signals. 

This is a qualitative approach to the problem. In order to identify 
and quantify the information, again, we felt the stimulus- 
environment approach to be appropriate* , 
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TABLE 1. SIGNALS PROVIDED BY RTDCS SOUND SIMULATION PROGRAM UNIT^ 



Sound Effect 


Required Signals 


Inpeller Whine Generator 


1. NL, RPM Left Engine 


Left Engine 


1. NR, RPM Ri^t Engine 


Right Engine 




CranL; Left Engine 


1. NL 




2. KL30IL, Flams 


Right Engine 


1. NR 




2. KK30IR, Flame 


Landing Gear Noises 


1. VPI, Trans laticnal 




Velocity (0 - 250 knots) 


Tire Rumble on Take-off and Landing 


1. VP, Translational Velocity 


Touch Dcwn Inpact , and Thunp 


2. In Air 


Tire Braking Screech Left and Ri^t 


1. VP, Translational Velocity 




2 . In Air 


After Burner Noise Left Engine 


1. KK302L, A/B Left Engine 


Rigiit Engine 


2. KK302R, A/B Right Engine 


Air Noise 


1. VP, Translational Velocity 



1. Adopted from NAVTRADEVCEN Technical Report 67-C-0196-7, 
Januarv, 1969. 
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V/l^icn cues and sources are considered in terms of application to 
the simulator a second problem must be considered, There are 
extraneous sounds correlated with the operation of the simulator 
rvlatfom whid\ do not correlate with control of the aircraft 
simulated. These can mask relevant cues also. Masking platforrrH 
cx>rrelated cues with white noise is not desirable because of the 
possible interactions this noise may have with the relevant and 
non-relevant cues correlated with the simulated aircraft. Therefore, 
special consideration is required in that the platform must be 
suitably isolated such that extraneous noises associated with its 
operation do not interfere with the presentation of cues for control. 

Since it is possible to present correlated cues for control only 
in a qualitative sense it is recommended that further work be under- 
taken in order that the cues may be vnore quant if iably specified so 
that their use may be facilitated. There are^ of course 5 
considerations for such an undertaking. Obviously, subjects should 
have hearing ability documented so that adequate relationships may 
be inferred on the basis of ocntrol cue sounds and hearing abilities. 

Too, any experimental evidence gathered in a laboratory setting 
vjhich is not representative of the pilot’s control task may produce 
misleading or incorrect data. Assuming, therefore, accepted 
laboratory procedures, this report suggests alternatives that could 
be follc^jed in order that analysis and synthesis of aural cues for coitrol 
migiit be accomplished. 

Generally, hi^ quality recordings of the sound fj-elds at the 
pilot’s station should he nadc in conjunction v;itli changes in 
appropriate relevant control parameters. Detailed statistical 
analyses of these recordings is necessary in terms of spectral 
densities, harmonics, and correlations with the control parameters. 

Then the sjTithesis of the acoustic environment by electronic means 
suital:)ly ccntrollable by a digital coirputer could be acconplished, 
and various combinations of synthesized signals could be presented 
to experienced pilots for evaluaticn of the relative effect of 
particular corponents of the acoustic field. 

An alternative procedure for processing the acoustic signals 
would be to pre-process the recorded signals by an analog real- 
time spectral analyzer and, with appropriate interface equipment, 
handle the majority of the other processing by digital computation. 

The advantages of the digital coirputer in accuracy, ease of storage, 

?nd retrieval of data as well as the increased flexibility in output 
formats and ease of program modification bias the analysis in its 
favor. The hybrid package may produce results more quickly than 
either analog or digital systems alone. 

V/ith regard to sound presentat5.on, a method of presenting aud.io 
signals can he formulated withort the use of electrc^iic oscillators 
and attenuators. The recorded signals, after having been analyzed, 
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could be stored and brought into an audio buffer as a function of 
the phase of flijri^t being simulated. The buffer would serve two 
purposes. First, it v;ould hold a given length signal and second, 
it would allcw modification as a function of system status. A 
double-buffering technique could be enployed to stay ahead of the 
system dynamics if necessary. This approach would have to be 
analyzed in regard to modification of the audio spectrum with 
dianging system dynamics but the relatively unchanging nature of 
the sound spectrum due to maintaining the aircraft in fixed states 
over periods of time my prove it to be a feasible approach. 

Figure 5.1 represents a flow chart diagram of a proposed data 
collection and analysis system. An advantage would be independence 
of fixed electronics and variability (by program change) of the 
sound spectrum. 

In tl\e current RTIXS system outlined previously the sounds that 
can be generated are limited to the simple functions of rpm and 
the electronic oscillators and attenuators external to the computer. 
Such a system lacks the flexibility necessary for research on the 
auditory cue problem. 

If an adaptive system is desired (i.e., presentation of various 
component frequencies of the total sound spectrum with changes based 
on level of controllabilit^O then an all-electric sound system such 
as the RTDCS becomes too restrictive in an experimental system. 
Regardless of mode of presentation, the analysis and synthesis of 
the audio spectrum are prerequisites to the design of an aural cue 
presentation system in the simulator. 
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Calibrated 




r5-{^ure5.1. A Proposed Data Collect ioii and Analysis Technique. 
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G.O INTJJRAQ’IONS AMCIJG CUi:S 



Thc' essence and the cormlexity of the problem of the necessary 
cues to be incorporated into a ground b^ed trainer centers about 
tlie interactions among the cues. That is, that the utility or non- 
utility, inportance or non- importance . of a cue in one sense modality 
may be and usually is contingent or dependent upon the cues being 
received by another. This section attenpts to en\jimerate and to 
describe some of those interactions or contingencies which are 
felt to be particularly important with respect to training devices. 

6.1 VISUAL Airo MOTION niTERACriON 

Many of the salient TXDints v;ith respect to the interaction 
tetvjeen visual and motion cues have been presemited in Chapters 2.0 
and 3.0, Visual Cues and Motion Cues respectively. Specific inter- 
active effects deemed of particular importance are discussed here. 

6.1.1 lOominance of Cues 



Both the in-fli|;^t and the moving base simulator environment are 
such that the total perception of motion generated by each is, in 
general, an ambiguous background of information. Unambiguous motion 
cues emerge from this background through addition of information 
from other sensoi"y sources such as vision. In an aircraft maneuvering 
in such a menner so that the gravito- inertial vector is oriented 
approximately normal to the pilot, the motion perception is the same 
as if the pilot were flying strai^t and level. The interaction 
of this motion perception with visual cues provides the correct 
orientation inf ormaticn , The additional information from the visual 
scene is needed since the motion receptors are not adapted to 
movement in the larger three dimensional space in whi.ch aircraft 
maneuver. It is obvious that the visual scene must be clearly 
definitive and quite dominant in order to overcome a motion perception 
v;hidi, in a natural environment, v/ould convey to the human that he 
is stationary and seated upriglit with respect to the ground. 

The occurrence of vertigo in IFF. fli^t is a common enouj^ 
illustration of lack of visual dominance. The display on a fyro 
horizon is seldom a sufficiently conpelling cue to prevent tie 
interactions of the motion perception with otlier visual phenoimena 
such as peripheral cloud particle flew or banked cloud layers. 

'Ihe factors vjhich may cause cues in a visual scene to exert dominance 
over motion cues have been cited in Chapter 2.0. This dominance of 
the visual scene results in the primary cue being derived from the 
visual sense, relegating to the proprioceptive sense the provision 
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of the conp lenient ary cue. The motion perception is not always 
ambiguous, however. As mentioned in Chapter 4.0, in those maneuvers 
or in certain phases of maneuvers where the correlation between 
natural and aircraft motion environment is hi^, the motion cues 
become primary and the visual cues conplementary (if it is present) 
or conflicting: (if absent or out of phase). 

0*1.2 Cain of the Visual Display and Motion Cue s 

The essence of this problem lies in the fact that, when the 
operator and his vehicle move in space, it is the characteristics of 
the movement, i.e. , its frequency or amplitude, which determine 
whether or not the operator v;ill sense the moveir^nt first throueh 
his motion or his visual senses. For movements of the aircraft 
around the aircraft axes, i.e. , attitudinal changes, motions are 
sucli that tliey will be sensed first through the motion senses. Thie 
visual senses are relied upon to corroborate or to substantiate the 
information received by the motion senses. Thus, the more qualitative 
aspects of the visua] scene may be important when the interaction with 
tlie motion senses are considered. In some systems the rate of 
movement such that the visual senses are able to detect the fact of 
novcTOnt before the motion senses. Such a sla^; moving system may be 
envisioned as the gradual drift of a spacecraft. Or the aircraft 
system may gradually drift into a bank or pitdi below the threshold 
for motion perception uith the first cue to the deviation l.>eing to 
tlie visual sense ^ Ihus, the dynamics response of the system is an 
underlying parcimeter influencing the interaction between visual, and 
motion cues. It may be Ir/pothesized that the trainer required for 
transiti.oning experienced pilots to instrument flying of large aircraft 
could be entirely effective without motion due to the lew rates of 
movement involved. On the other hand, training for lorj altitude high 
speed flight in which the pilot may be controlling a much lighter air- 
craft as a v/eapons platform may be hypothesized to require the lead 
information provided by the motion cues and thus require motion in 
the trainer for effective training. An examination of the difference 
between time to rise above threshold for the different sense 
modalities is important to the understanding of the interactions of 
cues . 

6.1.3 Platform Motion and Color in the Visual Disnlav 



In the discuss icn of the variable of color as a visual cue it 
was postulated tliat it was not considered to be of b*igh value as a 
primary relevant cue to control of the vehicle. It was stated, 
hovjever, that it could exert an indirect effect through enhancing 
contrast or increasing the acceptability of the device to the trainee. 

In the discussion of the interaction of motion with visual cues 
it was indicated that the interpretation of the motion cues are 




71 



64 



NAVrRADEVCEN-6 9-C-O 30 4-1 



dependent for tlieir interpretation upon supporting or conplementary 
visual cues. This conplementary nature (or conflicting nature) 
of the visual cue is inportant to the motion cue interpretation. It 
is postulated, therefore, that the variable of color in the visioal 
display perfomns a supporting or conplementary role to notion cues 
provided the colors are such as to enhance the acceptability of the 
visual display to the trainee. 

6.2 CWTROL MOVEMENT AND MOTION CUE INTEFACTION 

The problem of the interaction between the control movev.-.nt and 
motion cues was touched upon in Chapter 3.0. In that chapter it 
was stated that the cues of concern here, i.e., the feedback through 
the muscle senses frcm moving a control, act as a feed forward or 
quickening loop to provide information to the trainee of the action 
of the ve}iicle. Hiat is to say that the feedback through the 
kinesthetic senses as a result of control motion allows the operator 
of a closed loop vehicle system to *'sort out” the motion cues he 
receives which are^ due to his inputs into the macliine and those which 
are due to externa?' forcing functions. To the extent that the trainee 
comes to depend upon these kinesthetic cues and to learn to 
discriminate their characteristics, perceptual discrepancies 
betvjeen the trainer and tlie actual system to which he will transfer 
may act to create negative transfer. Tl^iat is to say he comes to 
depend upon his kinesthetic feedback as information relevant and 
necessary to precise control. 

Ihe information received through the proprioceptive mechanisms 
of the arm may be dependent u^on the force-displacement ratio in 
the manipulator, the danping and inertia of the manipulator, the 
degx'ce of learning of the controlled element response to manipulator 
force or position output, as well as the degree of feedbad^ infor- 
mation present in the manipulator force (and/or position) concerning 
the controlled element response. This last factor is the cue 
mechanized by bobweight feedback to the aircraft longitudinal ccntrol 
stick. In this case the pilot is presented v;ith information 
concerning aircraft movement through the control stick by means of 
the effects of gravitv and aircraft accelerations upon the bobwei^t 
resultant pull on the stick. It is hypothesized that the general 
effect of the bobweight feedback is to provide lead information to 
the pilot in a manner similar to that provided by postural and 
labyrinthine informaticn. The frequencies at which lead is provided 
by bobweij^t feedback is a function of the system desigji parameters. 
The relationship of this frequency range of information conpared 
to that provided by control stick dynamics is not knawn. Neither is 
the contribution of control stick dynamics to controlled element /pilot 
dynamics, Yp Yc (See G:-=?pter 3.0). Tire experiments carried out 
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by Herzog (19G9) appear to indicate that stick dynamics matched 
to controlled clement dynandcs raise the Yp Yc crossover frequency 
consideraI.)ly hipj’ier tlian proprioceptive information. This would 
load one to infer that the information provided by control stick 
(tynamicG is considerably in advance of other cue sources. 

6.3 CONTROL WV1:MCNT FEEDBACK AND VISUAL CUES 

17ie argument with respect to the interaction between kinesthetic 
and visual cues is exactly the same as that presented in Section 6.2 
with respect to the interaction of kinesthetic and notion cues, lhat 
is to say that the kinesthetic feedback operates to provide the 
operator with advance information as to the results of his inputs 
as well as to allcw him to sort out the result of his inputs from 
external forcing function inputs to the system. In the case of 
visual displays tliis sorting out of operator inputs from those of 
the external forcing functions is particularly relevant vjhcn the 
task of the operator is one of corrpensatory closed loop control. 
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7*0 PERFORI'IANCE MEASUREMENT AND EXPERBCNTATION 



7 . 1 GDIERAL DISCUSSION 

The question to which a final answer is sought by these 
investigations is the relationship between the degree of incorporation 
of cues into the ground based trainer and the amount of transfer to 
the actual system. To carry out such experiments the classical 
savings in training time paradigm described in Gagne, Foster and 
C'ra/zley (1948) could be used. 'Ihe use of tliis experirrental paradigm 
renuircs ti'/o groups of trainees, one of which receives training in 
the sijTTulator and transfers to the aircraft while the other receives 
training in the aircraft only. An examination of the problem soon 
reveals, however, that transfer of training experiments in whi.ch 
operational or training aircraft are involved are difficult, time 
cons\iming and expensive. Tlie fact of their interference v;ith ongoing 
training projp^fis or at least v;ith ongoing trainees nresents diffi- 
culties vjhich are formidable. 

It is recommended here that transfer of training experiments in 
the major areas discussed in this report be prefaced by other 
experimentation. These experiments are felt to be necessarily 
antecedent to transfer experiments in order that the experimental 
varial^les may be defined explicitly and meaningfully. The results 
of this preliniinary experimentation may be used in two v;ays , either 
to specify variables in transfer experinrients or, depending upon the 
assumptions one v;ishes to make, as data upon which to base simulator 
specifications. The basis for rsoommending this preliminary 
experimentation is set forth in the following discussion. 

The point has been made by Matheny (1968) and others that the 
basis for a simulator specification should not be that it represents 
the physical cdiaracteristics of the aircraft system it simulates, 
lather, its specificatiois should be based upon characteristics of 
the real aircraft vjhich are perceptible to the pilot. That is to 
say that the simulator should incorporate perceptual or psychological 
realism rather than physical realism. This argument has been extended 
to say that it 5.s pointless to build into the simulator characteristics 
v/hich cannot be perceived or discriminated by the operator. It has 
also included the postulation that perceptual realism in the simulator 
can be created by physical characteristics otlier than those which 
bring about perceptual realism in the aircraft. 

'Ihe central problem in simulator specification is the determination 
of vjhat perceptual characteristics to build into the simulator in 
order to maximize its effectiveness for transfer of training to the 
actual aircraft. T!\is would suggest that transfer of training 
studies are in order. Hewever, we recommend that there is a necessary 
first step before transfer of training experiments are conducted. 
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'Ihis step is tJiat of detenninaji)7 what physical characteristics 
produce perceptual discriminations (cues) in the context of piloting 
an aircraft, for example, tlie question may be raised as to what 
cliaracteristics of the motion of an aircraft are perceptible to the 
pilot and are influential in his control of that system, 'fhe 
specification of the measurable diaracteristic of motion which is 
perceptible and related to pilot control behavior is required to be 
de/ce rminecl before transfer of training experiments can he 
economically undertaken. This first step, i.e., determining the 
physical paraTTeter which underlies and gives rise to perceptual 
discriminations and caitrol behavior, serves to set the limits on 
the physical parameters and to provide the experimental variables 
for transfer of training experiimsnts. Once the quantifiable physical 
parameters of the simulator which provide the perceptual cues are 
kno^;n, transfer of training experimentation may be initiated to 
do.termdnc the effect of their inclusion and/or variation upon transfer 
of training. 

Once the relationsliip bet\7cen physical, quantitative parameters 
and perceptual Ix^liavior has been mapped out , the assumption could 
nvide that the effectiveness of a training device is a function 
oF tlie degree to v;hich it incorporates those physical characteristics 
giving rise to tliese rercentua]. cues. However, it must be emphasized 
that the assumption relating degree of incorporation of cues to 
degree of transfer of training has not been empirically established. 
This is the function of transfer of training experiments. 

To recapitulate, the first and necessary step is to determine 
what physical and measiirable parameters of simulators are related 
to perceptual and control behavior. That is, it is necessary to 
identify and describe the physical parameters, vary them and determine 
if they are indeed related to control behavior. It can then be 
said that those "cues" which give rise to pilot behavior, and, 
when chianged or elimdnated do change his behavior have been identified. 
Given thi.s information and making the assumption that am>ount of 
transfer is directly related to degree of incorporaticn of cues, 
certain conclusions wit}i respect to the configuration of an effective 
trainer may be reached, lhat is, design specifications may be based 
upon the information that certain diaracteristics provide certain 
cues to the pilot in the control of his vehicle. Hewever, the 
empiricist will v;ish to taJ<e those physical characteristics which 
have been found to provide cues to control and determine experimentally 
how their variation in training device affects transfer of training. 

It is tlie transfer of training experimentation v;hic}-i is relatively 
much more expensive and difficult to do. 

At first glance the difficulty and expense of carrying out 
transfer of training experiments seem almost prohibit ive. Not a 
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little of the difficulty centers around obtaining subjects from the 
training or operational commands for use in carrying out the 
researoh. Another is the support of high perfomance operational 
aircraft. There are possible alternatives, however, to training in 
a conplex simulator such as the TRADEC and transfer to an operational 
aircraft of the F-4 type. 

One alternative is to establish the simulator itself as the 
criterion or transfer aircraft. This would require obtainLng 
detailed data recordings of aircraft system outputs (altitude, 
heading, roll rate, bank angles, etc.) and pilot ir.puts for a 
series of representative naneuvers in the operational aircraft. 

From these data the simulator could be configured ao as to require 
the same pilot inputs in obtaining the same system outputs for these 
maneuvers. Ihis configuration of the TRADEC would then be used as 
the transfer .or "operational aircraft" to which transfer of training 
from experimental configurations is measured. Althou^ the 
representativeness of the simulator as a transfer aircraft can be 
criticized on several grounds this alternative does offer certain 
advantages. Ifest importantly, differences between the training or 
experimental configuration of the simulator and the criterion con- 
figuration can be tightly and systematically controlled. Transfer 
effects are not ccnfounded by other direct or interactive effects 
of differences between the simulator and the transfer aircraft. 

The "pure", so to speak, effects of changes in the simulator upon 
transfer carl therefore be isolated. 

As another alternative, genuine transfer of training experiments 
could be cai,Tied out much less expensively using either uiilitary or 
non-military subjects through sin^ating a smaller training aircraft 
which is less expensive to operate. This would require obtaining 
the pertinent aircraft data and appropriate modification of software 
and hardware in the simu3.ator. For a serious long range program of 
research to determine the direct enpirical relationships between 
simulator characteristics, training technology and transfer of 
training this approach has much to reccamend it. It will be noted 
that it would be concerned with a lower e^qjerience level trainee 
rather than the transitioning experienced pilot, 

7.2 PERPDRMANCE MEASUREf€irr 

Appropriate measures of performance must be selected whether 
carrying out the recommended cue identifying research or transfer of 
training experinents. For cue identifying experiments it is 
reconmended that perfore^nee be measured in two major areas. These 
are (1) system output and (2) operator output. By system output is 
meant the measurement of system parameters directly related to the 
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perfomance of the pilot and the task he is dealing. Examples of 
these are pitch rate, pitch angle, altitude and heading. Further, 
system output parameters of interest will be specific to the 
tasks being perfcjrmed. For example, in the approach and landing 
task vertical and lateral deviations from the required track 
tlirou^ space, i.e., deviations from the glide path and localizer, 
would be of direct interest with respect to measuring system output. 

By operator o'vJtput is meant the control movements which the 
pilot makes as inputs into the aircraft system in bringing about the 
desired outputs. The temporal and spatial patterning of the ccntrol 
inputs made in order to exercise appropriate closed loop control of 
the system are the phenomena of interest which require summarization. 
The frequency and amplitude characteristics of the ccntrol inputs 
would appear to be important ways in vArlch control input patterns 
can vary in response to changed system characteristics. These 
characteristics may be summarized Ihrou^ use of power density 
spectra, auto-correlaticn or, more simply, or standard deviation. 

In transfer of trHining experiments interest is centered 
primarily upon system output althoiigh control input data may be 
important to the understanding of the results of the experiment. In 
the classical transfer of training experiment the trainee practices 
until he reaches some stated level of proficiency in controlling 
system output both in the simulator and the aircraft. Proficiency 
levels are set on such system output parameters as airspeed, altj.tude, 
etc. Transfer is measured in terms of time saved, or additional time 
necessary, in attaining proficiency in the aircraft after practice 
in the simulator. To the exetent that ccntrol techniques learned in 
the simulator are the same as required (or can be quickly adapted 
to those required) in the aircraft positive transfer will occur. 
Hcur/ever, if the control techniques acqirired in the simulator are 
inappropriate to the aircraft negative transfer may occur. Therefore, 
the recording and analysis of control input data, both in simulator 
and aircraft whenever possible, will greatly aid the understanding 
of the factors affecting transfer of training. 

7.3 VISUAL CUE EXPERIICNTATTON 

In Chapter 2.0 dealing with visual cues, experiments were 
suggested using the tethered Jaycopter in which training under 
experimental visual conditions could be compared with training under 
the more realistic and representative actual cenditiens. Upon 
cansideraticn of experimental apparatus availability and the relative 
importance of the several visual cue problems, it is recommended 
that a numiber of experiments can be carried out in this equipment 
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which would yield useful data. These experdjnents fall into four 
major areas; (1), a coiparison of performance tinder ccnditions of 
binocular and mon>ocnlLar cues for helicopter hovering, (2) the 
effect upon perfoimance of the method of encoding of the relevant 
variables for control of the six degrees of freedcsn of the heli- 
copter during hover, (3) a test of the Matheny and Thielges model 
which proposes to predict the precision of helicopter control as a 
function of the placement of internal and external referents, and 
(4) a test of the relative applicability of different geometrical 
descriptiens of visual space. 

7.3.1 Monocular Versus Binocular Experimentation 

The J^copter offers the opportmity for conducting a true 
transfer of training e;q)eriment in vdiich the trainee is trained under 
monocular conditions and then transferred to fli^t under binocular 
conditions. The dxral control feature of this equipment will allow 
the student to be trained in a manner analogous to oonventiaial 
helicopter training in which the instructor allows the student to 
master single and then cembinations of dimensions of control. Further, 
the carputer controlled airtcpilot feature which nay be added to this 
equipnent would make possible the study of the monocular vs. binocular 
cue problem over a range of vehicle dynamics. 

As a first experiment it is recoramended that a classical Gagne 
(1948) transfer of training paradigm be used in which the degree of 
transfer in terms of t:ime saved is determined throu^ the training of 
an e:q)erimental and control group. Since the hovering maneuver is 
one of the first in the training curriculum it should not necessarily 
be required that the subjects in the experiment be candidates for 
pilot training. It may be possible to obtain subjects fretn Training 
Ctenter permanent personnel or draw from the basic trainee group of 
the Center. It is recemmended that the standard Navy selection tests 
be given the subjects and only those used as subjects who would 
qualify for pilot training. It is also recemmended that in all tests 
in vhich visual and motion cues are the subjects of inquiry that 
subjects be given the Rod- Frame Test or Embedded Figures Test 
to determine their visual field dependency or ii;dependency. 

It will be necessary to conduct pre-tests or pilot studies to 
determine final performance criteria in the device. Criteria may be 
established as holding altitude and X-Y translational position within 
set limits. Transfer of training is then measured in terms of time 
to reach these criteria. 

7.3.2 E^qjerimentation with Respect to Encoding of Visual Cues 

/^pendix A lists visual cues which depend upm certain external 
referents in the pilot's field of view and certain internal referents 




71 

nr 



NAVTRADEVCEN-6 9-C-O 304-1 



v^iich are an integral part of his veliicle. Experimentation concemed 
with the encoding of the external visual world so as to provide 
external referents is inextricably confounded with the test of 
the Matheny-Thielges model discussed in the next Section, 7.3.3. 
Hcwever, the major experimental variable, the encoding of the 
external world scene so as to provide the necessary and sufficient 
information for control of the vehicle is discussed here.. 

Appendix A, suggests that cues may be enumerated in terms of 
their relevancy for various dimensions of ccntrol of the vehicle. 

That is to say that certain cues are relevant to control of pitch, 
others to control of roll, etc. The external world encodement 
v/hich provides the relevant cue for control of pitch and roll is 
postulated to be an horizon line with a representation of the ground 
plane as being a secondary cue. X and Y position on this grc:iund 
plane is dependent upon soime identifiable point upon the ground plane 
as the external referent. Control of altitude or deviations along 
the Z axis may be postulated as being dependent upon the cue of 
change in retinal size of scrre object or, more precisely, change in 
the perceived distance between t\-Jo objects positioned on a ground 
plane sottk distance from tlie observer which the pilot observes at a 
particular angle of regard. 

VJith respect to the encodement of the ground plane and the 
horizon, work carried out under the Arny-Navy Instrumentation Program 
indicated that a wide variety of encodings, when interpreted in a 
static display, provided the necessary and sufficient information for 
judgnents of pitch and roll of the vehicle (Matheny S Hardt, 1959 j 
Elam, Emery S Matheny, 1961). Experiments carried out in the motion- 
base simulator also indicated that a grid plane, i.e., the ground 
plane encoded by a series of grid lines, provided the necessary and 
sufficient cue for the pilot to maintain his pitch, roll and position 
in the X-Y plane. 

Eiqjeriments carried out in the helicopter !.ising a quite crude 
grid plane display also demonstrated that the pilot could carry out 
the task of hovering and maintaining of X-Y position quite well with 
a very limited grdd line representation of the ground plane as his 
visual display. (Wilkerson S Matheny, 1961c). Hcwever, only one 
transfer of training experiment was carried out. In tliat e;<i'eriment 
(Feddersen 8 liatheny, 1962) subjects were trained until they had 
reached an asynptotic level of performance since the object of the 
experiment was not primarily that of transfer of training and no 
ccntrol group was trained. The results are, therefore, not hi^ly 
informative except that, under the conditions of the stucty, a hi^ 
level of positive transfer appeared to take place. The Jaycopter 
offers the opportunity for carrying out transfer of training 
experiments using different encodings of the postulated visual cues 
for the six dimensions of ccntrol of the helicopter. 
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"’Ilf' oncodinp of those cues which will enal:>lo the pilot to mal-ie 
tlio judpinents of tlie renuired accuracy with respect to altitude is a 
rra;]or problem wliidi v;as not solved in the ANIP program* IXiring 
tests of the prid line display in the actual helicopter (V?ilkerson f, 
Matheny, 1961c) altitude was encoded through use of a vertical 
scale display v;hich gave accurate qualitative, i.e., nrecise but 
non-nuantitative information. It v/as an analog of the real world 
cnly in the sense that a marker moved up and down in a slot and the 
correct altitude v;as attained when the marker was kept at a 
designated position in the slot. The encoding of the external 
referents so as to provide the relevant cues for altitude control, 
therefore, have not been determined in any precise way. 

It should be pointed out that the study of color versus achromatic 
displays can be undertaken in the Jaycopter. It is necessary for both 
the encoding experiments and the color experiments that a surround 
be constructed around the Jaycopter such that tlie encoding of the 
relevant cues in the external world can be systematically and 
quantitatively varied. 

7.3,3 Test of the Matheny-Thielges Ibdel 

'Ihe model developed by llatheny and Thielges for describing the 
cue structure for the pilot in hoverinp: the helicorter has been 
described briefly in Chapter 2,0. It is described in detail in 
Matheny and Tldelges (1965) and in Thielges and Matheny (1966). In 
brief, to develop the model an analysis was made in which the 
necessary and sufficient cues were postulated for maintaining control 
of the helicopter in its six degrees of freedom of pitch, roll, yaw, 
altitude, fore and aft, and lateral translation, A model was 
developed expressing the relationship between the cue sources in the 
external world and the information they provide for control by 
dimension of veMcle motion, i.e., pitch, roll, yaw, and X, Y, Z 
translation. 

It v;as postulated that a critical parameter in describing 
these cues v/cis the relationsliip between an internal referent on the 
vehicle itself and an external referent in the real world visual 
scene. The internal referent could be an index v;hich was motionless 
relative to the aircraft sudi as a structural member of the airxuraft. 
The external referent was defined as being a fixed point on the 
ground plane and/or horizon external to the vehicle. From the model, 
postulates can be derived predicting the precision of control of the 
vehicle as a function of the area in the visual scene at whidi the 
external and internal referents are located, the relationship or 
distance between the two referents, and the vehicle dimension of 
control being exercised. From the model are derived information 
density plots which identify those areas of the windscreen from 
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v.’hicli maximum information may be obtained by the pilot as a function 
of his dimension of control and placement of internal and external 
referents. 

A test of the model using laboratory equipment and a modified 
psydiophvsical technique supported the validity of the model 
(Thielges, 1966). Predictions with respect to detection of deviations 
of the internal referent from the external referent as a function of 
tile various parameters of control were canfirmed. In addition, a 
serendipitous finding emerged. This finding was that for certain 
encoding of the ground plane there was a gradual drift of the internal 
referent away from the external referent in a manner similar to the 
drift of an auditor^' standard. Thus, identifiable forms or obiects 
upon the ground plane were iiraxjrtant in order to maintain the required 
Tuxtaposition between internal and externa] referent or simply to 
maintain the identify of the external referent. If this finding is 
verified or supported in a more dynamic and conplete experimental 
anparatus such as the Jaycor^ter, it is iiqxirtant for the encoding 
of the ground plane particularly for those encodings created by 
computer graphics. The Jaycopter lends itself to the test of this 
model and to a test of the dependence/ of the predictions upon the 
way in which the ground plane is encoded. Experiments carried out 
in the test of tliis model can and should be carried out simultaneously 
with the ground enccxling experiments recommended in Section 7.3.2. 

7.3.4 Geometric Description of Visual Space 

The l-'atheny-Thielges model described in Section 7.3.3 is based 
upon perspective geometry, sometimes cal.led picture plane geometry. 

This geometry/ assumes a linear projection of the real world serene 
upon a two dimensional surface viewed by the pilot. It would 
appear that Gibson's description of visual spac:e is also dependent 
upon sucJi geometry. 

The v;ork of Luneburg (1947) and the relevant experimental work 
deserrilied by Blank (1959, 1961) v7ould indicate that visual space 
may ])est be described as J?iemannian with constant Gaussian curvature. 
The essential problem would appear to be the sign of the curvature (K) ; 
whether it is positive (spherical geometry) negative (hyperbolic) or 
zero (Euclidian), The results of experimental investigations would 
indicate that at small distanexTS visual space might best be described 
as Pienannian spac:e with constant Gaussian curvature of negative 
sign, i.e., it is hyperbolic. 'That is to say that objects lying on 
a transverse plane or line v7ould appear to be bewed away from the 
sul)ject. At medium, distances the objects vrould appear to lie on a 
transverse straight line and be best described by Euclidian geometry, 
i.e. , Gaussian curvature v7xth zero sign. At greater distances 
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objects lying on a transverse line would appear to be bowed toward 
the subject, i.e., best described by spherical geometry or Riemannian 
space with constant Gaussian curvature of positive sign. Such 
curves have been called Helmholtz geodesics and Luneburg (1947) 
presents a method of confuting the distances at which the curve 
exliibits no bowing. 

l^/hether the questions rai.sed by Luneburg ’s theory of visual 
space are inportant to the generation of visual displays for ground 
based trainers may or may not be of practical significance. It is 
telieved and recommended, ho;ever, that the full implications of the 
v;ork on the description of visual space be investigated for its 
possible importance to visual di^splays. It may mean simply that the 
projection surface or the surface on v/hich the visual scene is 
displayed must 1 >b curved, i.e., circular. Until such an examination 
of the theory and the experimental data can be made no specific 
exjx^rimenta]. design or variables can l>e detailed. 

7.3.b Experimental Apparatus for Use in Research on Visual Cues 

In censideration of all tlie experimental questions being raised 
v;ith respect to the presentation of the visual cues v/hich represent 
the external world, t]\e type of experimental apparatus required is 
dependent somewhat upon the priorities assigned to the questions. 

One of tliose questions upon whicJi we have focused attention is that 
of the designation of the relevant cues and hew tliey are encoded 
into a t\‘jo dimensional representation of the three dimensional world. 
Ihe question has also been raised about the effect of masking cues, 
and particular, the training value of requiring the trainee to sort 
out the relevant cues from overlying perceptions which tend to mask 
those cues. 

In carrying out research on the method of encoding the ground 
plane it appears mandatory that the encoding be capable of being 
vard.ed from the strict stylized perspective geometrical form to that 
approaching what would be characterized as perceptually equivalent 
to the real world scene with realism cues liberally added. It is 
necessary that the forms and relationships among forms, planes and 
surfaces in the visual scene be capable of being specified precisely 
v/h'ether upen a transverse plane or curved surface. The most cost- 
effective means at this time for varying visual scene content would 
appear to be a terrain model with T.V. pickup such that the content 
of the display can te varied systematically and over a wide range. 
Further, sudi a system allcv/s for the intixduction of color as a 
variable . 

Ihe projection of the scene viev/ed by the pilot may be upon a 
flat tv70 dimensional surface or through collimated optics creating 
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a virtual iirviga, llius, the pros and ccns of virtual imagery as a 
varial'^le in the training situation can be studied* 

At present the television system has certain problems with 
respect to resolution and brightness. Atteirp-ts to study the extent 
of the field of view will be confounded with problems of display 
illumination and resolution. As discussed in. Chapter 2,0 resolution 
is a confounding variable in that it effects the perceived contrast. 

It also interacts with color in that color msiy enhance contrast and, 
therefore, resolution. In the study of color as a variable, resolution 
will likely be a confounding problem with the eouipment being 
reoonrrended here in that resolution attained by color television 
systems has not reached that attainable by the black and white 
systems. Despite the resolution limitations, however, it is felt 
that such a system, on balance, would offer the greatest flexibility 
and capability for studying the problem of visual cues at this time. 

The expense and effort to obtain a high resolution teilevision 
system from whi' ch may be obtained the maximum illuminance used in 
connection with a physical terrain model v?ith its flexibility for 
changing models upon the ground plane would seem to be the most 
desirable solution to the visual attachment research tool at the 
present time, 

7,4 11OTI0N CUE EXPERiriENTATIOh 

The fundamental question with respect to the characteristics of 
a simulator motion platform is twofold. First, it is necessary to 
determine what its response characteristics should be in order that 
it provide cues perceptually equivalent to those in the aircraft. 
Second, the contribution made by the introduction of motion into the 
train5j\g simulator must 1x2 determined eirpirically. The alternative 
to empirical transfer of training experiments is the assurrption 
discussed in Section 7.1 that degree of transfer is directly a 
function of the incorporation of perceptual cues. 

V/ith regard to the first question, i.e,, the perceptual response 
characteristics of the platform, it must be determined not only what 
this response capability must be to provide relevant control cues. 

It must also be determined what capabilities will accommodate those 
motions which are disruptive to performance or which ma.sk relevant 
cues. 



Consideration mast also be given to the value of uncorrelated 
motion upon simulator acceptance by the pilot with its possible 
indirect effect upon training and transfer. The determination of 
that bandwidth of uncorrelated motion which does not interfere with 
relevant cues and at the same time provides random "breakloose” 
motion also is iipportant. 
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7.4.1 Uncorrelated Motion 



As pointed out in Section 3.4.1 the introduction of uncorrelated 
motion into t)ie simulator platform may not be the simple matter it 
first appears. Such motion must be essentially random so that it 
provides the pilot with the sensation of not being "glued" to the 
ground in a simulator. At the same time its frequency bandwidth 
must be set so that perception of that motd.on is not falsely 
interpreted as a relevant control cue. 

The discussion given in Chapter 3.0 relative to the resonant 
and disturbing frequencies for the head and eyes (approximately 
5 and 11 Ife, resr>ectively) would indicate that these frequencies 
shoiald be avoided. The frequencies at 2.5 Hz would appear from the 
literature to be important aids to visual tracking and therefore 
discriminable as relevant cues. The bandwidth between approximately 
3 and 5 Hz and above 12 Hz would then be suggested as the most likely 
candidate for noncorrelated random motion. This postulation is in 
need of experimental investigation. 

7.4.2 Correlated Motion 

Correlated motion is that motion which coincides with some 
change in the aircraft system of interest to the pilot and which can 
]->rovide a cue to this cJhange. Normally the motions of the total 
aircraft system in three dimensional space are those upon which 
interest is centered. For specifying vAiat olatform frequency 
response is appropriate for these motions a method of describing and 
measuring the physical characteristics of the motion must be adopted. 
Tills has been discussed in Section 3.5.1 and the description of 
platform characteristics in the frequency domain has been chosen. 

The experimental question is vjhat effective (i.e. , harA-;are and 
software) frequency bancbjidth sliould the motion platform be capable 
of providing in order to provide the pilot of a closed man-machine 
system with the relevant cues to movement of the system in space. 

From the discussion in Chapter 3.0 the bandwidth from 0 throu{^ 3 Hz 
should be investigated for the determination of both the upper and 
lower breal; frequency. From the available data the postulations may 
1 x 2 made that t)ie upper break point should be about 2.5 Hz, There 
are much less data to support postulations about the lower break 
point. Some very tentative data exists (Stapleford, et al., 1969) 
vjhich suggests that this point could be as hij^ as 2.0 rad/sec. 

Ihe 0 Hz condition is, of course, no motion at all and must be 
seriously considered for certain tasks, systems, and levels of pilot 
experience. That is to say that the utility of motion is task, pilot 
and system specific and investigations aimed at contributing to the 
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Host cost-effective solution to the simulator motion problem must 
take this fact into account. The zero motion condition then must 
1 x 2 considered as one level of the experimental variable of motion. 
Its interactive effect with task and pilot experience and response 
diaracterlstics of the aircraft being controlled may then be 
determined experimentally and conpared with other levels of the 
motion variable. 
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8.0 SUI'IJ^iARY' 



This report concerns the problems of multi-sensory cueing: 
specifically the relationships between visual, aural, notion and 
control movement cues and idle dimensions of aircraft control; the 
establishment of an analytic basis for cue investigation; the 
suggestion of research topics; and the determination of simulator 
facility/ suitability. 

Based on pertinent literature, expert judgjnent, pilot reports, 
and investigator experience a cue taxonomy was developed which 
included sets of relevant and non-relevant cues. Relevant cues 
were sul:>-divided into primary, secondary, complementary, and 
conflicting cues v;hile the non-relevant cues were considered as 
a .^rroup wliich serves to add realism to the situation. 

IWo analytic bases for postulating cues vjere defined as the 
stimulus environment approach and the information array approach. 

The former attenpts to specify the physical energy spectra of the 
airercift system available to ajid sensible by the pilot and from 
which the cue or cues v;ould be identified. The information array 
approach hynotliesized that information is displayed as an array of 
cues and the problem is therefore to identify and select the 
appropriate cue or cues used in control. Both approaches were aimed 
at identifying and describing the physical, quantifiable parameters 
vjjiicli provide stimulus sources for the cues since the ultimate 
cri'Lerion i;as the application of the cues to the flight trainer. 

Implicit in the investigation of cues for control vjas the 
Ir/pothesis that there is some learned standard or referent for 
controi. and that t}iere is a controllable index which may be adjusted 
relative to the standard. 

Us?xig the information array approach, several hypotheses were 
developed regarding the visual cues required for aircraft control. 

(\\e important question involves the relative adequacy of monocular 
cues for control. It was h^/pothesized that, if monocular cues 
could be demonstrated to he adequate then perspective geometry 
V70uld be suitable as a descriptive method for the identification 
and quantification of the cues for tra5.ner application. Consequently 
a series of experiments were recommended to determine the relative 
cffici.ency of monocular and binocular cues in a variety of tasks 
such as the transfer effect going from monocular training to 
binocular operational tasks. 

Other visual problems have proved vjorthy of hypotheses regaixiing 
their role as cues for control. It was proposed that the advantages 
and disadvantages of color be explored in terms of whether color is 
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a sipnif leant cue for control or merely adds realism. An empirical 
investio;ation of collimated display systems was also proposed in 
order to answer such questions as the comparison between a flat 
plane tvjo dimensional projection versus one using virtual imagery. 

The field of view was pointed to as another inportant area 
which required empirical investigation. Variables such as the 
extent of the horizontal visual horizon, the configuration of the 
ground plane, and the density/ and shape of the textural elements 
defining the ground plane are relevant problems. 

r^'jstulates as to cues for motion have been presented based 
upon considerations of tlie results in the physiological^ psychophysical 
and behavioral sciences literature. Findings in these areas were 
discussed and experiments have been outlined vJiidi are designed to 
test the validity of the postulates and lead to their verification 
or modification. 

General considerations were outlined and concepts such as 
"exoskeletcn*^ were introduced in which the pilot is presumed to 
view the aircraft as an extension of himself. The interrelationships 
betvjeen muscle tension, postural tonus, and the vestibular were 
developed to form a theoretical frairework from v;hich postulates could 
\ye derived in terms of motion sensing. 

Before training device requirements could be specified, it was 
pointer! out, an analysis of platform motion would be necessary. It 
v;as thus ]')roposed that motion be analyzed using frequency/ analyses in 
order to specify performance criteria. The description of the 
system characteristics would then allovj for a specification on the 
system response to ciny driving function, thus maJ-cing it possible 
to vary the system cliaracteristics systematically and then determine 
tlie relation of this variation to pilot control behavior. 

Kinesthetic cues were operationally defined as cues derived by 
the operator from the movements of his limbs as he actuates controls. 

It v;as pointed out that little has been puixlished regarding the 
use of kinesthetic cues in control. However, the inportance of 
feedback is generally ackno^/ledged. 

Interactive aspects of feedback information were presented and 
it v;as proposed that the construct, ”the effective time constant”, 
be used to assess the characteristics of the control device by 
measuring and systematically varying it as the independent variable. 

The stimulus environment approadi was deemed the more feasible 
for investigating the problem of auditory cues. Several hypotheses 
were generated regarding possible aural cue sources for aircraft 
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control but the main contention dealt with accurate information about 
such sources in terns of aiiplitude, frequency, and coirplexity of 
the wave forms generating the cues. Because the ultimate goal is 
the presentation of aural cues in the trainer, accurate information 
about characteristics of the cues is required to N^erify the 
postulations that pi :d\ and loudness serve as the auditory cues for 
control. This was not deemed a sinple operation, however, and it 
v/as pointed out that other considerations are necessary. As a 
consequence of the necessity for additional information it was 
recommended that sound recordings at the operator's station in 
cockpits of the aircraft of interest be made so that tlie postulates 
could be either verified or modified. Special considerations for 
recording were presented along with a possible data gathering approach. 

Hypotheses v/ere presented regarding interactions dimong cues 
V7)iid'i have a direct implication for cue application to the trainer. 

It v;as pointed out tliat there are possible interactions between the 
visual and notion cues in terms of dominance of the cue and the 
fact that cues can change from primary to complement cary to conflicting 
etc. Further, there may be an interaction between the gain of the 
visual display and the motion cues. Color of the display was seen 
as a possible source of interaction with the notion cue derived from 
the platform motion. 

It was also pointed out that there could be an interactive 
effect bet^/zeen tlie kinesthetic and motion cues. This would involve 
particularly the feedl^ack loop. Too, the possibility of inter- 
action between kinesthetic feedback and visual cues was deenod 
important . 

Finally, it was pointed out in this report that the ultimate 
question to which an answer is sought deals with the relationship 
between the degree of incorporation of cues into the ground based 
trainer and the amount of transfer to the actual system. 

Sever\il contingencies make the transfer-of -‘training experiments 
costly in terms of money, manpov/er, and training time. Alternatives 
vjore suggested. 

It was pointed out that the Jaycopter could be utilized as a 
tool for visual experiments. Such alternatives assume that there 
is a relationship between the degree of trainer effectiveness and 
the degn.’G to which relevant cues are incorporated into the trainer. 

A concomitant variable is the preblem of p>erforTnance measurement since 
the question to be ansv/ered is v/hether the trainer requires the same 
responses as does the aircraft. 
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It was proposed that performance be measured dn terms of system 
outy)Ut and operator output. System output was defined as the 
mc.TSurement of system parameters directly related to the perfomance 
of the pilot and the task performed while by operator performance is 
mc<ant the spatial and temporal pattern of the control movements 
which the pilot makes in bringing about the desired system outputs. 
ItxDccdures for these performance measurements vjere then outlined, 
;/ith especial reference to testing visual parameters. 
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APPENVJX A 



POSTULATED CONTACT l/ISUAL CUES FOR AIRCRAFT CONTROL 



MOTE: Postulated cues listed assume constraints on the 

size of the visual display to be 60 deppees either 
side of the midline in azimuth and 30 dejrrees above 
and below the level flight horizon line. 
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